2023-11-25 12:53:14,809 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-25 12:53:15,053 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4 2023-11-25 12:53:15,069 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-25 12:53:15,070 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/cluster_099e5cbf-51cd-003d-9e5e-00eb47e6e9bf, deleteOnExit=true 2023-11-25 12:53:15,070 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-25 12:53:15,071 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/test.cache.data in system properties and HBase conf 2023-11-25 12:53:15,071 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/hadoop.tmp.dir in system properties and HBase conf 2023-11-25 12:53:15,072 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/hadoop.log.dir in system properties and HBase conf 2023-11-25 12:53:15,073 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-25 12:53:15,073 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-25 12:53:15,073 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-25 12:53:15,197 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-25 12:53:15,681 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-25 12:53:15,687 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-25 12:53:15,687 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-25 12:53:15,688 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-25 12:53:15,688 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-25 12:53:15,688 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-25 12:53:15,689 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-25 12:53:15,689 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-25 12:53:15,690 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-25 12:53:15,690 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-25 12:53:15,690 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/nfs.dump.dir in system properties and HBase conf 2023-11-25 12:53:15,691 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/java.io.tmpdir in system properties and HBase conf 2023-11-25 12:53:15,691 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-25 12:53:15,692 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-25 12:53:15,692 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-25 12:53:16,422 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-25 12:53:16,428 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-25 12:53:16,823 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-25 12:53:17,027 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-25 12:53:17,048 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-25 12:53:17,092 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-25 12:53:17,124 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/java.io.tmpdir/Jetty_localhost_42913_hdfs____.rfy4jd/webapp 2023-11-25 12:53:17,277 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42913 2023-11-25 12:53:17,289 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-25 12:53:17,289 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-25 12:53:17,804 WARN [Listener at localhost/45839] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-25 12:53:17,894 WARN [Listener at localhost/45839] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-25 12:53:17,917 WARN [Listener at localhost/45839] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-25 12:53:17,925 INFO [Listener at localhost/45839] log.Slf4jLog(67): jetty-6.1.26 2023-11-25 12:53:17,930 INFO [Listener at localhost/45839] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/java.io.tmpdir/Jetty_localhost_46457_datanode____.dk9s79/webapp 2023-11-25 12:53:18,040 INFO [Listener at localhost/45839] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46457 2023-11-25 12:53:18,385 WARN [Listener at localhost/45289] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-25 12:53:18,828 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9592243184359672: Processing first storage report for DS-c2dd1048-6fcc-4a4b-87d4-3daaa76c66ec from datanode b85de168-f567-4fe6-a311-baf86bbdb821 2023-11-25 12:53:18,829 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9592243184359672: from storage DS-c2dd1048-6fcc-4a4b-87d4-3daaa76c66ec node DatanodeRegistration(127.0.0.1:40501, datanodeUuid=b85de168-f567-4fe6-a311-baf86bbdb821, infoPort=33327, infoSecurePort=0, ipcPort=45289, storageInfo=lv=-57;cid=testClusterID;nsid=678997463;c=1700916796538), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-11-25 12:53:18,830 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9592243184359672: Processing first storage report for DS-8b453178-51c2-4e11-8fd3-2d69d6e1fd4d from datanode b85de168-f567-4fe6-a311-baf86bbdb821 2023-11-25 12:53:18,830 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9592243184359672: from storage DS-8b453178-51c2-4e11-8fd3-2d69d6e1fd4d node DatanodeRegistration(127.0.0.1:40501, datanodeUuid=b85de168-f567-4fe6-a311-baf86bbdb821, infoPort=33327, infoSecurePort=0, ipcPort=45289, storageInfo=lv=-57;cid=testClusterID;nsid=678997463;c=1700916796538), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-25 12:53:18,917 DEBUG [Listener at localhost/45289] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4 2023-11-25 12:53:19,030 INFO [Listener at localhost/45289] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/cluster_099e5cbf-51cd-003d-9e5e-00eb47e6e9bf/zookeeper_0, clientPort=63200, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/cluster_099e5cbf-51cd-003d-9e5e-00eb47e6e9bf/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/cluster_099e5cbf-51cd-003d-9e5e-00eb47e6e9bf/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-25 12:53:19,052 INFO [Listener at localhost/45289] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63200 2023-11-25 12:53:19,063 INFO [Listener at localhost/45289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-25 12:53:19,066 INFO [Listener at localhost/45289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-25 12:53:19,765 INFO [Listener at localhost/45289] util.FSUtils(471): Created version file at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f with version=8 2023-11-25 12:53:19,766 INFO [Listener at localhost/45289] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/hbase-staging 2023-11-25 12:53:20,076 INFO [Listener at localhost/45289] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-25 12:53:20,525 INFO [Listener at localhost/45289] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=3 2023-11-25 12:53:20,557 INFO [Listener at localhost/45289] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-25 12:53:20,557 INFO [Listener at localhost/45289] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-25 12:53:20,558 INFO [Listener at localhost/45289] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-25 12:53:20,558 INFO [Listener at localhost/45289] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-25 12:53:20,558 INFO [Listener at localhost/45289] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-25 12:53:20,705 INFO [Listener at localhost/45289] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-25 12:53:20,780 DEBUG [Listener at localhost/45289] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-25 12:53:20,872 INFO [Listener at localhost/45289] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38201 2023-11-25 12:53:20,882 INFO [Listener at localhost/45289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-25 12:53:20,884 INFO [Listener at localhost/45289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-25 12:53:20,907 INFO [Listener at localhost/45289] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38201 connecting to ZooKeeper ensemble=127.0.0.1:63200 2023-11-25 12:53:20,953 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:382010x0, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-25 12:53:20,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38201-0x100249a8a3e0000 connected 2023-11-25 12:53:20,990 DEBUG [Listener at localhost/45289] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-25 12:53:20,991 DEBUG [Listener at localhost/45289] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-25 12:53:20,994 DEBUG [Listener at localhost/45289] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-25 12:53:21,002 DEBUG [Listener at localhost/45289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38201 2023-11-25 12:53:21,003 DEBUG [Listener at localhost/45289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38201 2023-11-25 12:53:21,003 DEBUG [Listener at localhost/45289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38201 2023-11-25 12:53:21,004 DEBUG [Listener at localhost/45289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38201 2023-11-25 12:53:21,005 DEBUG [Listener at localhost/45289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38201 2023-11-25 12:53:21,011 INFO [Listener at localhost/45289] master.HMaster(444): hbase.rootdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f, hbase.cluster.distributed=false 2023-11-25 12:53:21,083 INFO [Listener at localhost/45289] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-11-25 12:53:21,083 INFO [Listener at localhost/45289] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-25 12:53:21,083 INFO [Listener at localhost/45289] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-25 12:53:21,084 INFO [Listener at localhost/45289] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-25 12:53:21,084 INFO [Listener at localhost/45289] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-25 12:53:21,084 INFO [Listener at localhost/45289] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-25 12:53:21,089 INFO [Listener at localhost/45289] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-25 12:53:21,091 INFO [Listener at localhost/45289] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37051 2023-11-25 12:53:21,094 INFO [Listener at localhost/45289] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-25 12:53:21,100 DEBUG [Listener at localhost/45289] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-25 12:53:21,101 INFO [Listener at localhost/45289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-25 12:53:21,103 INFO [Listener at localhost/45289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-25 12:53:21,106 INFO [Listener at localhost/45289] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37051 connecting to ZooKeeper ensemble=127.0.0.1:63200 2023-11-25 12:53:21,109 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:370510x0, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-25 12:53:21,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37051-0x100249a8a3e0001 connected 2023-11-25 12:53:21,110 DEBUG [Listener at localhost/45289] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-25 12:53:21,112 DEBUG [Listener at localhost/45289] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-25 12:53:21,113 DEBUG [Listener at localhost/45289] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-25 12:53:21,113 DEBUG [Listener at localhost/45289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37051 2023-11-25 12:53:21,116 DEBUG [Listener at localhost/45289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37051 2023-11-25 12:53:21,116 DEBUG [Listener at localhost/45289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37051 2023-11-25 12:53:21,118 DEBUG [Listener at localhost/45289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37051 2023-11-25 12:53:21,118 DEBUG [Listener at localhost/45289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37051 2023-11-25 12:53:21,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38201,1700916799909 2023-11-25 12:53:21,130 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-25 12:53:21,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38201,1700916799909 2023-11-25 12:53:21,152 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-25 12:53:21,152 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-25 12:53:21,152 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-25 12:53:21,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-25 12:53:21,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38201,1700916799909 from backup master directory 2023-11-25 12:53:21,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-25 12:53:21,158 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38201,1700916799909 2023-11-25 12:53:21,158 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-25 12:53:21,159 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-25 12:53:21,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38201,1700916799909 2023-11-25 12:53:21,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-25 12:53:21,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-25 12:53:21,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/hbase.id with ID: 8c3b9973-770a-44f4-b6bb-0b3d9e7adec8 2023-11-25 12:53:21,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-25 12:53:21,301 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-25 12:53:21,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x093c56c0 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:53:21,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54bab2f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:53:21,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-25 12:53:21,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-25 12:53:21,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-25 12:53:21,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-25 12:53:21,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-25 12:53:21,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-25 12:53:21,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-25 12:53:21,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/MasterData/data/master/store-tmp 2023-11-25 12:53:21,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:53:21,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-25 12:53:21,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-25 12:53:21,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-25 12:53:21,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-25 12:53:21,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-25 12:53:21,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-25 12:53:21,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-25 12:53:21,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/MasterData/WALs/jenkins-hbase4.apache.org,38201,1700916799909 2023-11-25 12:53:21,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38201%2C1700916799909, suffix=, logDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/MasterData/WALs/jenkins-hbase4.apache.org,38201,1700916799909, archiveDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/MasterData/oldWALs, maxLogs=10 2023-11-25 12:53:21,968 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40501,DS-c2dd1048-6fcc-4a4b-87d4-3daaa76c66ec,DISK] 2023-11-25 12:53:21,975 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-25 12:53:22,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/MasterData/WALs/jenkins-hbase4.apache.org,38201,1700916799909/jenkins-hbase4.apache.org%2C38201%2C1700916799909.1700916801921 2023-11-25 12:53:22,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40501,DS-c2dd1048-6fcc-4a4b-87d4-3daaa76c66ec,DISK]] 2023-11-25 12:53:22,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:53:22,038 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:53:22,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-25 12:53:22,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-25 12:53:22,098 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-25 12:53:22,106 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-25 12:53:22,138 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-25 12:53:22,154 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:53:22,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-25 12:53:22,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-25 12:53:22,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-25 12:53:22,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:53:22,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62647089, jitterRate=-0.06648562848567963}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-25 12:53:22,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-25 12:53:22,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-25 12:53:22,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-25 12:53:22,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-25 12:53:22,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-25 12:53:22,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-25 12:53:22,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 33 msec 2023-11-25 12:53:22,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-25 12:53:22,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-25 12:53:22,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-25 12:53:22,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-25 12:53:22,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-25 12:53:22,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-25 12:53:22,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-25 12:53:22,313 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-25 12:53:22,316 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-25 12:53:22,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-25 12:53:22,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-25 12:53:22,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-25 12:53:22,339 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-25 12:53:22,339 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-25 12:53:22,339 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-25 12:53:22,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38201,1700916799909, sessionid=0x100249a8a3e0000, setting cluster-up flag (Was=false) 2023-11-25 12:53:22,357 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-25 12:53:22,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-25 12:53:22,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38201,1700916799909 2023-11-25 12:53:22,373 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-25 12:53:22,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-25 12:53:22,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38201,1700916799909 2023-11-25 12:53:22,384 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.hbase-snapshot/.tmp 2023-11-25 12:53:22,423 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(954): ClusterId : 8c3b9973-770a-44f4-b6bb-0b3d9e7adec8 2023-11-25 12:53:22,427 DEBUG [RS:0;jenkins-hbase4:37051] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-25 12:53:22,434 DEBUG [RS:0;jenkins-hbase4:37051] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-25 12:53:22,434 DEBUG [RS:0;jenkins-hbase4:37051] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-25 12:53:22,440 DEBUG [RS:0;jenkins-hbase4:37051] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-25 12:53:22,442 DEBUG [RS:0;jenkins-hbase4:37051] zookeeper.ReadOnlyZKClient(139): Connect 0x143d412e to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:53:22,448 DEBUG [RS:0;jenkins-hbase4:37051] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1afaadd9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:53:22,448 DEBUG [RS:0;jenkins-hbase4:37051] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ec52a5e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-25 12:53:22,477 DEBUG [RS:0;jenkins-hbase4:37051] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37051 2023-11-25 12:53:22,480 INFO [RS:0;jenkins-hbase4:37051] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-25 12:53:22,480 INFO [RS:0;jenkins-hbase4:37051] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-25 12:53:22,481 DEBUG [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1025): About to register with Master. 2023-11-25 12:53:22,484 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,38201,1700916799909 with isa=jenkins-hbase4.apache.org/172.31.14.131:37051, startcode=1700916801082 2023-11-25 12:53:22,499 DEBUG [RS:0;jenkins-hbase4:37051] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-25 12:53:22,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-25 12:53:22,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-25 12:53:22,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-25 12:53:22,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-25 12:53:22,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-25 12:53:22,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-11-25 12:53:22,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-25 12:53:22,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-25 12:53:22,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-25 12:53:22,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1700916832519 2023-11-25 12:53:22,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-25 12:53:22,527 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-25 12:53:22,528 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-25 12:53:22,534 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-25 12:53:22,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-25 12:53:22,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-25 12:53:22,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-25 12:53:22,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-25 12:53:22,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-25 12:53:22,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-25 12:53:22,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-25 12:53:22,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-25 12:53:22,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-25 12:53:22,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-25 12:53:22,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-25 12:53:22,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700916802555,5,FailOnTimeoutGroup] 2023-11-25 12:53:22,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700916802556,5,FailOnTimeoutGroup] 2023-11-25 12:53:22,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-25 12:53:22,558 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44351, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-25 12:53:22,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-25 12:53:22,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-25 12:53:22,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-25 12:53:22,574 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38201] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:22,589 DEBUG [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f 2023-11-25 12:53:22,589 DEBUG [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:45839 2023-11-25 12:53:22,589 DEBUG [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2023-11-25 12:53:22,595 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-25 12:53:22,595 DEBUG [RS:0;jenkins-hbase4:37051] zookeeper.ZKUtil(163): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:22,595 WARN [RS:0;jenkins-hbase4:37051] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-25 12:53:22,596 INFO [RS:0;jenkins-hbase4:37051] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-25 12:53:22,596 DEBUG [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1951): logDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/WALs/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:22,597 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37051,1700916801082] 2023-11-25 12:53:22,605 DEBUG [RS:0;jenkins-hbase4:37051] zookeeper.ZKUtil(163): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:22,614 DEBUG [RS:0;jenkins-hbase4:37051] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-25 12:53:22,622 INFO [RS:0;jenkins-hbase4:37051] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-25 12:53:22,639 INFO [RS:0;jenkins-hbase4:37051] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-25 12:53:22,643 INFO [RS:0;jenkins-hbase4:37051] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:53:22,643 INFO [RS:0;jenkins-hbase4:37051] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:53:22,644 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2023-11-25 12:53:22,651 INFO [RS:0;jenkins-hbase4:37051] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-25 12:53:22,651 DEBUG [RS:0;jenkins-hbase4:37051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-25 12:53:22,651 DEBUG [RS:0;jenkins-hbase4:37051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-25 12:53:22,651 DEBUG [RS:0;jenkins-hbase4:37051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-25 12:53:22,651 DEBUG [RS:0;jenkins-hbase4:37051] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-25 12:53:22,652 DEBUG [RS:0;jenkins-hbase4:37051] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-25 12:53:22,652 DEBUG [RS:0;jenkins-hbase4:37051] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-25 12:53:22,652 DEBUG [RS:0;jenkins-hbase4:37051] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-25 12:53:22,652 DEBUG [RS:0;jenkins-hbase4:37051] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-25 12:53:22,652 DEBUG [RS:0;jenkins-hbase4:37051] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-25 12:53:22,652 DEBUG [RS:0;jenkins-hbase4:37051] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-25 12:53:22,653 INFO [RS:0;jenkins-hbase4:37051] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-25 12:53:22,653 INFO [RS:0;jenkins-hbase4:37051] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-25 12:53:22,653 INFO [RS:0;jenkins-hbase4:37051] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-25 12:53:22,677 INFO [RS:0;jenkins-hbase4:37051] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-25 12:53:22,680 INFO [RS:0;jenkins-hbase4:37051] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37051,1700916801082-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:53:22,699 INFO [RS:0;jenkins-hbase4:37051] regionserver.Replication(203): jenkins-hbase4.apache.org,37051,1700916801082 started 2023-11-25 12:53:22,699 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,37051,1700916801082, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37051, sessionid=0x100249a8a3e0001 2023-11-25 12:53:22,699 DEBUG [RS:0;jenkins-hbase4:37051] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-25 12:53:22,699 DEBUG [RS:0;jenkins-hbase4:37051] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:22,699 DEBUG [RS:0;jenkins-hbase4:37051] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37051,1700916801082' 2023-11-25 12:53:22,699 DEBUG [RS:0;jenkins-hbase4:37051] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:22,700 DEBUG [RS:0;jenkins-hbase4:37051] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:22,701 DEBUG [RS:0;jenkins-hbase4:37051] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-25 12:53:22,701 DEBUG [RS:0;jenkins-hbase4:37051] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-25 12:53:22,701 DEBUG [RS:0;jenkins-hbase4:37051] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:22,701 DEBUG [RS:0;jenkins-hbase4:37051] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37051,1700916801082' 2023-11-25 12:53:22,701 DEBUG [RS:0;jenkins-hbase4:37051] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-25 12:53:22,701 DEBUG [RS:0;jenkins-hbase4:37051] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-25 12:53:22,702 DEBUG [RS:0;jenkins-hbase4:37051] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-25 12:53:22,702 INFO [RS:0;jenkins-hbase4:37051] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-25 12:53:22,702 INFO [RS:0;jenkins-hbase4:37051] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-25 12:53:22,813 INFO [RS:0;jenkins-hbase4:37051] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37051%2C1700916801082, suffix=, logDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/WALs/jenkins-hbase4.apache.org,37051,1700916801082, archiveDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/oldWALs, maxLogs=32 2023-11-25 12:53:22,833 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40501,DS-c2dd1048-6fcc-4a4b-87d4-3daaa76c66ec,DISK] 2023-11-25 12:53:22,836 INFO [RS:0;jenkins-hbase4:37051] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/WALs/jenkins-hbase4.apache.org,37051,1700916801082/jenkins-hbase4.apache.org%2C37051%2C1700916801082.1700916802816 2023-11-25 12:53:22,837 DEBUG [RS:0;jenkins-hbase4:37051] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40501,DS-c2dd1048-6fcc-4a4b-87d4-3daaa76c66ec,DISK]] 2023-11-25 12:53:22,972 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-25 12:53:22,973 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-25 12:53:22,973 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f 2023-11-25 12:53:22,989 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:53:22,991 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-25 12:53:22,994 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/info 2023-11-25 12:53:22,994 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-25 12:53:22,996 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:53:22,996 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-25 12:53:22,998 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/rep_barrier 2023-11-25 12:53:22,999 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-25 12:53:23,000 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:53:23,000 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-25 12:53:23,002 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/table 2023-11-25 12:53:23,003 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-25 12:53:23,004 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:53:23,005 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740 2023-11-25 12:53:23,006 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740 2023-11-25 12:53:23,009 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-25 12:53:23,011 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-25 12:53:23,014 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:53:23,015 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61696116, jitterRate=-0.08065623044967651}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-25 12:53:23,015 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-25 12:53:23,015 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-25 12:53:23,015 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-25 12:53:23,015 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-25 12:53:23,015 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-25 12:53:23,015 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-25 12:53:23,017 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-25 12:53:23,017 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-25 12:53:23,021 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-25 12:53:23,021 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-25 12:53:23,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-25 12:53:23,040 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-25 12:53:23,043 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-25 12:53:23,195 DEBUG [jenkins-hbase4:38201] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-25 12:53:23,198 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37051,1700916801082, state=OPENING 2023-11-25 12:53:23,205 DEBUG [PEWorker-1] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-25 12:53:23,209 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-25 12:53:23,209 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-25 12:53:23,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:53:23,395 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:23,397 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-25 12:53:23,401 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-25 12:53:23,412 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-25 12:53:23,412 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-25 12:53:23,416 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37051%2C1700916801082.meta, suffix=.meta, logDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/WALs/jenkins-hbase4.apache.org,37051,1700916801082, archiveDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/oldWALs, maxLogs=32 2023-11-25 12:53:23,432 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40501,DS-c2dd1048-6fcc-4a4b-87d4-3daaa76c66ec,DISK] 2023-11-25 12:53:23,436 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/WALs/jenkins-hbase4.apache.org,37051,1700916801082/jenkins-hbase4.apache.org%2C37051%2C1700916801082.meta.1700916803417.meta 2023-11-25 12:53:23,436 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40501,DS-c2dd1048-6fcc-4a4b-87d4-3daaa76c66ec,DISK]] 2023-11-25 12:53:23,437 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:53:23,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-25 12:53:23,455 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-25 12:53:23,460 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-25 12:53:23,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-25 12:53:23,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:53:23,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-25 12:53:23,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-25 12:53:23,468 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-25 12:53:23,470 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/info 2023-11-25 12:53:23,470 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/info 2023-11-25 12:53:23,471 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-25 12:53:23,472 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:53:23,472 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-25 12:53:23,474 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/rep_barrier 2023-11-25 12:53:23,474 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/rep_barrier 2023-11-25 12:53:23,474 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-25 12:53:23,475 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:53:23,475 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-25 12:53:23,477 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/table 2023-11-25 12:53:23,477 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/table 2023-11-25 12:53:23,478 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-25 12:53:23,478 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:53:23,480 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740 2023-11-25 12:53:23,483 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740 2023-11-25 12:53:23,486 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-25 12:53:23,488 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-25 12:53:23,490 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75077447, jitterRate=0.11874113976955414}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-25 12:53:23,490 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-25 12:53:23,506 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1700916803387 2023-11-25 12:53:23,522 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-25 12:53:23,523 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-25 12:53:23,524 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37051,1700916801082, state=OPEN 2023-11-25 12:53:23,530 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-25 12:53:23,530 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-25 12:53:23,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=3, resume processing ppid=2 2023-11-25 12:53:23,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37051,1700916801082 in 319 msec 2023-11-25 12:53:23,539 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=2, resume processing ppid=1 2023-11-25 12:53:23,539 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 506 msec 2023-11-25 12:53:23,545 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1150 sec 2023-11-25 12:53:23,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1700916803545, completionTime=-1 2023-11-25 12:53:23,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-25 12:53:23,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-25 12:53:23,613 DEBUG [hconnection-0x25615df8-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:53:23,616 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:53:23,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-25 12:53:23,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1700916863634 2023-11-25 12:53:23,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1700916923635 2023-11-25 12:53:23,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 89 msec 2023-11-25 12:53:23,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38201,1700916799909-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:53:23,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38201,1700916799909-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-25 12:53:23,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38201,1700916799909-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-25 12:53:23,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38201, period=300000, unit=MILLISECONDS is enabled. 2023-11-25 12:53:23,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-25 12:53:23,666 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-25 12:53:23,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-25 12:53:23,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-25 12:53:23,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-25 12:53:23,687 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-25 12:53:23,689 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-25 12:53:23,711 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/hbase/namespace/e2b716da1809d768d144f498d4caadc1 2023-11-25 12:53:23,714 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/hbase/namespace/e2b716da1809d768d144f498d4caadc1 empty. 2023-11-25 12:53:23,714 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/hbase/namespace/e2b716da1809d768d144f498d4caadc1 2023-11-25 12:53:23,715 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-25 12:53:24,136 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-25 12:53:24,139 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e2b716da1809d768d144f498d4caadc1, NAME => 'hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:53:24,553 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:53:24,554 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e2b716da1809d768d144f498d4caadc1, disabling compactions & flushes 2023-11-25 12:53:24,554 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1. 2023-11-25 12:53:24,554 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1. 2023-11-25 12:53:24,554 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1. after waiting 0 ms 2023-11-25 12:53:24,554 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1. 2023-11-25 12:53:24,554 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1. 2023-11-25 12:53:24,554 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e2b716da1809d768d144f498d4caadc1: 2023-11-25 12:53:24,559 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-25 12:53:24,574 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700916804563"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916804563"}]},"ts":"1700916804563"} 2023-11-25 12:53:24,600 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-25 12:53:24,602 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-25 12:53:24,606 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916804602"}]},"ts":"1700916804602"} 2023-11-25 12:53:24,611 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-25 12:53:24,620 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e2b716da1809d768d144f498d4caadc1, ASSIGN}] 2023-11-25 12:53:24,622 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e2b716da1809d768d144f498d4caadc1, ASSIGN 2023-11-25 12:53:24,624 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e2b716da1809d768d144f498d4caadc1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:53:24,775 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e2b716da1809d768d144f498d4caadc1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:24,775 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700916804775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916804775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916804775"}]},"ts":"1700916804775"} 2023-11-25 12:53:24,780 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e2b716da1809d768d144f498d4caadc1, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:53:24,935 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:24,941 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1. 2023-11-25 12:53:24,942 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e2b716da1809d768d144f498d4caadc1, NAME => 'hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1.', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:53:24,942 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e2b716da1809d768d144f498d4caadc1 2023-11-25 12:53:24,943 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:53:24,943 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e2b716da1809d768d144f498d4caadc1 2023-11-25 12:53:24,943 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e2b716da1809d768d144f498d4caadc1 2023-11-25 12:53:24,945 INFO [StoreOpener-e2b716da1809d768d144f498d4caadc1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e2b716da1809d768d144f498d4caadc1 2023-11-25 12:53:24,947 DEBUG [StoreOpener-e2b716da1809d768d144f498d4caadc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/namespace/e2b716da1809d768d144f498d4caadc1/info 2023-11-25 12:53:24,947 DEBUG [StoreOpener-e2b716da1809d768d144f498d4caadc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/namespace/e2b716da1809d768d144f498d4caadc1/info 2023-11-25 12:53:24,948 INFO [StoreOpener-e2b716da1809d768d144f498d4caadc1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2b716da1809d768d144f498d4caadc1 columnFamilyName info 2023-11-25 12:53:24,948 INFO [StoreOpener-e2b716da1809d768d144f498d4caadc1-1] regionserver.HStore(310): Store=e2b716da1809d768d144f498d4caadc1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:53:24,950 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/namespace/e2b716da1809d768d144f498d4caadc1 2023-11-25 12:53:24,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/namespace/e2b716da1809d768d144f498d4caadc1 2023-11-25 12:53:24,955 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e2b716da1809d768d144f498d4caadc1 2023-11-25 12:53:24,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/namespace/e2b716da1809d768d144f498d4caadc1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:53:24,959 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e2b716da1809d768d144f498d4caadc1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59000366, jitterRate=-0.12082603573799133}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-25 12:53:24,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e2b716da1809d768d144f498d4caadc1: 2023-11-25 12:53:24,961 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1., pid=6, masterSystemTime=1700916804935 2023-11-25 12:53:24,965 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1. 2023-11-25 12:53:24,965 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1. 2023-11-25 12:53:24,967 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e2b716da1809d768d144f498d4caadc1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:24,967 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700916804966"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916804966"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916804966"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916804966"}]},"ts":"1700916804966"} 2023-11-25 12:53:24,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=6, resume processing ppid=5 2023-11-25 12:53:24,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e2b716da1809d768d144f498d4caadc1, server=jenkins-hbase4.apache.org,37051,1700916801082 in 191 msec 2023-11-25 12:53:24,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=5, resume processing ppid=4 2023-11-25 12:53:24,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e2b716da1809d768d144f498d4caadc1, ASSIGN in 354 msec 2023-11-25 12:53:24,979 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-25 12:53:24,979 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916804979"}]},"ts":"1700916804979"} 2023-11-25 12:53:24,982 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-25 12:53:24,986 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-25 12:53:24,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-25 12:53:24,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3100 sec 2023-11-25 12:53:24,990 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-25 12:53:24,990 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-25 12:53:25,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-25 12:53:25,053 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-25 12:53:25,060 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-11-25 12:53:25,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-25 12:53:25,079 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-25 12:53:25,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-11-25 12:53:25,097 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-25 12:53:25,100 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-25 12:53:25,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.941sec 2023-11-25 12:53:25,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-25 12:53:25,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-25 12:53:25,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-25 12:53:25,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38201,1700916799909-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-25 12:53:25,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38201,1700916799909-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-25 12:53:25,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-25 12:53:25,130 DEBUG [Listener at localhost/45289] zookeeper.ReadOnlyZKClient(139): Connect 0x42f95205 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:53:25,136 DEBUG [Listener at localhost/45289] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dd83e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:53:25,151 DEBUG [hconnection-0x18b1d570-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:53:25,164 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:53:25,173 INFO [Listener at localhost/45289] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38201,1700916799909 2023-11-25 12:53:25,175 DEBUG [Listener at localhost/45289] zookeeper.ReadOnlyZKClient(139): Connect 0x2131ff51 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:53:25,180 DEBUG [Listener at localhost/45289] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37318dfa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:53:25,180 INFO [Listener at localhost/45289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-25 12:53:25,225 INFO [Listener at localhost/45289] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=213, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=318, ProcessCount=171, AvailableMemoryMB=8362 2023-11-25 12:53:25,236 DEBUG [Listener at localhost/45289] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:53:25,239 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:53:25,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-25 12:53:25,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:25,258 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-25 12:53:25,260 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-25 12:53:25,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-25 12:53:25,264 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:25,265 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e empty. 2023-11-25 12:53:25,266 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:25,266 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-25 12:53:25,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-25 12:53:25,283 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-25 12:53:25,285 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1ec2e29f51499fb50f28c15f7410a96e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:53:25,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-25 12:53:25,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-25 12:53:25,698 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:53:25,699 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 1ec2e29f51499fb50f28c15f7410a96e, disabling compactions & flushes 2023-11-25 12:53:25,699 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:25,699 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:25,699 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. after waiting 0 ms 2023-11-25 12:53:25,699 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:25,699 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:25,699 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:25,704 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-25 12:53:25,705 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700916805705"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916805705"}]},"ts":"1700916805705"} 2023-11-25 12:53:25,708 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-25 12:53:25,710 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-25 12:53:25,710 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916805710"}]},"ts":"1700916805710"} 2023-11-25 12:53:25,712 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-25 12:53:25,717 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1ec2e29f51499fb50f28c15f7410a96e, ASSIGN}] 2023-11-25 12:53:25,718 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1ec2e29f51499fb50f28c15f7410a96e, ASSIGN 2023-11-25 12:53:25,720 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1ec2e29f51499fb50f28c15f7410a96e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:53:25,871 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1ec2e29f51499fb50f28c15f7410a96e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:25,871 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700916805871"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916805871"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916805871"}]},"ts":"1700916805871"} 2023-11-25 12:53:25,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 1ec2e29f51499fb50f28c15f7410a96e, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:53:25,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-25 12:53:26,028 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:26,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:26,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ec2e29f51499fb50f28c15f7410a96e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:53:26,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:26,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:53:26,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:26,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:26,039 INFO [StoreOpener-1ec2e29f51499fb50f28c15f7410a96e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:26,042 DEBUG [StoreOpener-1ec2e29f51499fb50f28c15f7410a96e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1 2023-11-25 12:53:26,042 DEBUG [StoreOpener-1ec2e29f51499fb50f28c15f7410a96e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1 2023-11-25 12:53:26,045 INFO [StoreOpener-1ec2e29f51499fb50f28c15f7410a96e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec2e29f51499fb50f28c15f7410a96e columnFamilyName family1 2023-11-25 12:53:26,048 INFO [StoreOpener-1ec2e29f51499fb50f28c15f7410a96e-1] regionserver.HStore(310): Store=1ec2e29f51499fb50f28c15f7410a96e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:53:26,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:26,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:26,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:26,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:53:26,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1ec2e29f51499fb50f28c15f7410a96e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70523966, jitterRate=0.05088898539543152}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-25 12:53:26,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:26,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e., pid=11, masterSystemTime=1700916806028 2023-11-25 12:53:26,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:26,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:26,069 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1ec2e29f51499fb50f28c15f7410a96e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:26,069 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700916806069"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916806069"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916806069"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916806069"}]},"ts":"1700916806069"} 2023-11-25 12:53:26,076 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=11, resume processing ppid=10 2023-11-25 12:53:26,076 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 1ec2e29f51499fb50f28c15f7410a96e, server=jenkins-hbase4.apache.org,37051,1700916801082 in 198 msec 2023-11-25 12:53:26,079 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=10, resume processing ppid=9 2023-11-25 12:53:26,080 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1ec2e29f51499fb50f28c15f7410a96e, ASSIGN in 359 msec 2023-11-25 12:53:26,081 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-25 12:53:26,081 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916806081"}]},"ts":"1700916806081"} 2023-11-25 12:53:26,083 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-25 12:53:26,088 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-25 12:53:26,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 834 msec 2023-11-25 12:53:26,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-25 12:53:26,388 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-25 12:53:26,405 DEBUG [hconnection-0x236d8801-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:53:26,409 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43130, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:53:26,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:26,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:26,568 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:26,568 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:26,569 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-25 12:53:26,569 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-25 12:53:26,570 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:26,570 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:26,572 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:26,572 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:26,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:26,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:26,572 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:26,572 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:26,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:26,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:26,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:26,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:26,574 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:26,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:26,576 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-25 12:53:26,577 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:26,577 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-25 12:53:26,578 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:26,578 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:26,578 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:26,579 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. started... 2023-11-25 12:53:26,580 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ec2e29f51499fb50f28c15f7410a96e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-25 12:53:27,158 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304adc1c9c1df64ae98a59793f20ea0135 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511304adc1c9c1df64ae98a59793f20ea0135 2023-11-25 12:53:27,574 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/5b30ef0416eb42b58cbc82c3c9da754e 2023-11-25 12:53:27,585 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/5b30ef0416eb42b58cbc82c3c9da754e as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/5b30ef0416eb42b58cbc82c3c9da754e 2023-11-25 12:53:27,594 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/5b30ef0416eb42b58cbc82c3c9da754e, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-25 12:53:27,598 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1ec2e29f51499fb50f28c15f7410a96e in 1018ms, sequenceid=5, compaction requested=false 2023-11-25 12:53:27,599 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:27,602 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:27,602 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:27,602 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-25 12:53:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-25 12:53:27,606 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,606 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:27,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:27,606 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,606 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:27,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:27,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:27,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:27,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-25 12:53:27,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e1d851c[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:27,609 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-25 12:53:27,609 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,611 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,611 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-25 12:53:27,611 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-25 12:53:27,611 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,611 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:27,611 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:27,614 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,614 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-25 12:53:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:27,614 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:27,615 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-25 12:53:27,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:27,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:27,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:27,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:27,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-25 12:53:27,619 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-25 12:53:27,619 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:27,619 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:27,619 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,619 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:27,623 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,623 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:27,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:27,623 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:27,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:27,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:27,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:27,624 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:27,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,627 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:27,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,636 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,636 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,637 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,637 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:27,637 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:27,637 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,637 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:27,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:27,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:27,637 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:27,637 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:27,638 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:27,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:27,639 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:27,640 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:27,740 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:27,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:27,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:27,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:27,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,758 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:27,758 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:27,759 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-25 12:53:27,759 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-25 12:53:27,760 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,760 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,765 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:27,765 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:27,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:27,766 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:27,766 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,767 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,767 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-25 12:53:27,767 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:27,767 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-25 12:53:27,767 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:27,768 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-25 12:53:27,768 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:27,768 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:27,768 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:27,768 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. started... 2023-11-25 12:53:27,768 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ec2e29f51499fb50f28c15f7410a96e 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-25 12:53:28,201 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112880de0d69be1b42e490adc224ff9f66b2 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112880de0d69be1b42e490adc224ff9f66b2 2023-11-25 12:53:28,212 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/63d5a01ddf264601a6e8192377ad0246 2023-11-25 12:53:28,223 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/63d5a01ddf264601a6e8192377ad0246 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/63d5a01ddf264601a6e8192377ad0246 2023-11-25 12:53:28,232 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/63d5a01ddf264601a6e8192377ad0246, entries=1, sequenceid=9, filesize=5.0 K 2023-11-25 12:53:28,233 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1ec2e29f51499fb50f28c15f7410a96e in 465ms, sequenceid=9, compaction requested=false 2023-11-25 12:53:28,234 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:28,234 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:28,234 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:28,234 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:28,234 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,234 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-25 12:53:28,234 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-25 12:53:28,237 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,237 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:28,238 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,238 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:28,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:28,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:28,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:28,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-25 12:53:28,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@cc480f[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:28,240 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-25 12:53:28,241 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,242 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,242 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-25 12:53:28,242 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-25 12:53:28,242 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:28,243 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,243 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:28,246 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-25 12:53:28,246 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:28,246 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,246 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-25 12:53:28,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:28,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:28,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:28,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:28,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:28,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:28,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-25 12:53:28,251 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-25 12:53:28,251 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:28,251 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:28,251 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,251 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:28,253 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,253 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:28,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:28,253 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:28,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:28,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:28,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:28,255 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:28,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,257 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:28,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,262 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,262 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,262 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:28,262 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:28,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:28,262 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,262 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:28,262 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:28,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:28,262 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,262 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:28,263 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:28,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:28,263 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:28,263 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:28,364 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:28,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:28,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:28,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:28,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,378 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:28,378 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:28,378 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-25 12:53:28,378 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-25 12:53:28,379 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,379 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,381 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,381 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:28,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:28,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:28,382 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,382 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:28,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:28,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,383 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,383 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-25 12:53:28,383 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,383 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-25 12:53:28,383 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:28,384 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-25 12:53:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:28,386 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:28,386 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. started... 2023-11-25 12:53:28,386 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ec2e29f51499fb50f28c15f7410a96e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:28,816 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120159f5818996434bcf92ff889910d5be0b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120159f5818996434bcf92ff889910d5be0b 2023-11-25 12:53:28,828 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/624ab53c7796441b951bc64258cc3f83 2023-11-25 12:53:28,838 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/624ab53c7796441b951bc64258cc3f83 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/624ab53c7796441b951bc64258cc3f83 2023-11-25 12:53:28,846 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/624ab53c7796441b951bc64258cc3f83, entries=1, sequenceid=13, filesize=5.0 K 2023-11-25 12:53:28,848 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ec2e29f51499fb50f28c15f7410a96e in 461ms, sequenceid=13, compaction requested=true 2023-11-25 12:53:28,848 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:28,848 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:28,848 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:28,848 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:28,848 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,848 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-25 12:53:28,848 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-25 12:53:28,852 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,852 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:28,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:28,853 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,853 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:28,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:28,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:28,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:28,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-25 12:53:28,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bf34427[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:28,855 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-25 12:53:28,855 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,857 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,857 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-25 12:53:28,857 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-25 12:53:28,857 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:28,857 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,857 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:28,859 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,859 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-25 12:53:28,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:28,859 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:28,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:28,860 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-25 12:53:28,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:28,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:28,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:28,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:28,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-25 12:53:28,864 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-25 12:53:28,864 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:28,864 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:28,864 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,864 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:28,867 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,867 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:28,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:28,867 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:28,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:28,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:28,868 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:28,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:28,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,871 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:28,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,876 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,876 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,876 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,876 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:28,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:28,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:28,877 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:28,877 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,877 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,877 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,877 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:28,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-25 12:53:28,877 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:28,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:28,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:28,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:28,878 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:28,878 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:28,979 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:28,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:28,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:28,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:28,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,992 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:28,992 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:28,992 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-25 12:53:28,992 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-25 12:53:28,993 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,993 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,995 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,995 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:28,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:28,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:28,995 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:28,995 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:28,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:28,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,997 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,997 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-25 12:53:28,997 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:28,997 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-25 12:53:28,997 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:28,997 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-25 12:53:28,998 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:28,998 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:28,998 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:28,998 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. started... 2023-11-25 12:53:28,998 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ec2e29f51499fb50f28c15f7410a96e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:28,999 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-25 12:53:29,027 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120581da5932cf46405b940fb0a64950c497 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120581da5932cf46405b940fb0a64950c497 2023-11-25 12:53:29,088 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-25 12:53:29,089 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-25 12:53:29,451 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/e21ba85ef85043eb8c36946e85c25193 2023-11-25 12:53:29,462 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/e21ba85ef85043eb8c36946e85c25193 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/e21ba85ef85043eb8c36946e85c25193 2023-11-25 12:53:29,472 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/e21ba85ef85043eb8c36946e85c25193, entries=1, sequenceid=17, filesize=5.0 K 2023-11-25 12:53:29,474 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ec2e29f51499fb50f28c15f7410a96e in 476ms, sequenceid=17, compaction requested=true 2023-11-25 12:53:29,474 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:29,474 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:29,474 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:29,475 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:29,475 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,475 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-25 12:53:29,475 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-25 12:53:29,478 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,478 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:29,479 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,479 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:29,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-25 12:53:29,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bd53a43[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:29,481 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-25 12:53:29,481 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,483 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,483 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-25 12:53:29,483 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-25 12:53:29,483 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:29,483 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,483 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:29,491 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-25 12:53:29,491 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,491 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:29,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,491 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-25 12:53:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:29,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:29,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:29,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-25 12:53:29,495 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-25 12:53:29,495 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:29,495 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:29,495 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,496 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:29,506 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,506 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,506 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:29,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:29,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:29,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:29,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:29,507 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:29,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:29,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,509 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:29,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,513 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,513 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,513 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,514 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,514 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,514 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:29,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:29,514 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:29,514 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:29,514 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-25 12:53:29,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:29,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:29,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:29,514 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,515 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:29,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:29,515 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:29,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:29,615 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:29,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:29,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:29,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:29,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,628 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:29,628 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:29,628 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-25 12:53:29,628 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-25 12:53:29,629 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,629 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,631 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:29,631 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:29,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:29,632 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,632 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:29,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:29,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,633 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,633 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-25 12:53:29,633 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,633 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-25 12:53:29,633 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:29,634 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-25 12:53:29,634 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:29,634 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:29,634 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:29,634 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. started... 2023-11-25 12:53:29,635 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ec2e29f51499fb50f28c15f7410a96e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:29,655 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512289680cf3ddaf44a5498a7646cda5f81e0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512289680cf3ddaf44a5498a7646cda5f81e0 2023-11-25 12:53:29,666 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/d8ef0a2f96e245d8b94ba723e7e7a033 2023-11-25 12:53:29,673 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/d8ef0a2f96e245d8b94ba723e7e7a033 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/d8ef0a2f96e245d8b94ba723e7e7a033 2023-11-25 12:53:29,681 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/d8ef0a2f96e245d8b94ba723e7e7a033, entries=1, sequenceid=21, filesize=5.0 K 2023-11-25 12:53:29,682 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ec2e29f51499fb50f28c15f7410a96e in 47ms, sequenceid=21, compaction requested=true 2023-11-25 12:53:29,682 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:29,682 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:29,682 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:29,683 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:29,683 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,683 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-25 12:53:29,683 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-25 12:53:29,685 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,685 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:29,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:29,685 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,686 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:29,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:29,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:29,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:29,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-25 12:53:29,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79826940[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:29,688 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-25 12:53:29,688 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,690 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,690 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-25 12:53:29,690 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-25 12:53:29,690 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:29,690 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,690 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:29,692 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-25 12:53:29,692 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:29,692 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,692 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-25 12:53:29,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:29,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:29,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:29,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:29,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:29,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-25 12:53:29,696 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-25 12:53:29,696 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:29,696 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:29,696 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,696 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:29,698 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,698 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:29,698 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:29,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:29,699 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:29,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,701 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:29,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,704 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,704 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,704 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,705 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,704 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:29,705 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:29,705 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,705 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:29,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:29,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:29,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:29,705 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:29,705 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:29,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:29,706 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:29,706 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:29,806 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:29,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:29,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:29,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:29,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,850 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:29,850 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:29,850 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-25 12:53:29,850 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-25 12:53:29,851 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,851 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,853 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,853 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:29,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:29,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:29,854 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:29,854 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:29,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:29,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,855 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:29,855 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-25 12:53:29,855 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:29,856 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-25 12:53:29,856 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:29,856 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:29,856 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:29,856 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. started... 2023-11-25 12:53:29,856 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ec2e29f51499fb50f28c15f7410a96e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:29,878 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318df4560f027a4c7cb0ca3cc78bd80508 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512318df4560f027a4c7cb0ca3cc78bd80508 2023-11-25 12:53:30,072 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-25 12:53:30,073 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-25 12:53:30,289 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/feb14cf305a44ecdb0b19e9b3f223657 2023-11-25 12:53:30,298 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/feb14cf305a44ecdb0b19e9b3f223657 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/feb14cf305a44ecdb0b19e9b3f223657 2023-11-25 12:53:30,307 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/feb14cf305a44ecdb0b19e9b3f223657, entries=1, sequenceid=25, filesize=5.0 K 2023-11-25 12:53:30,309 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ec2e29f51499fb50f28c15f7410a96e in 453ms, sequenceid=25, compaction requested=true 2023-11-25 12:53:30,309 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:30,309 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:30,309 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:30,309 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:30,309 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,309 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-25 12:53:30,309 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-25 12:53:30,312 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,312 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:30,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:30,313 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,313 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:30,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:30,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:30,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:30,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-25 12:53:30,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b6cda4f[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:30,315 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-25 12:53:30,315 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,318 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,318 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-25 12:53:30,318 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-25 12:53:30,318 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:30,318 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,319 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:30,321 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-25 12:53:30,321 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:30,321 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,321 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-25 12:53:30,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:30,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:30,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:30,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:30,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:30,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-25 12:53:30,325 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-25 12:53:30,325 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:30,325 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:30,325 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,325 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:30,329 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,329 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,329 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:30,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:30,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:30,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:30,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:30,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:30,330 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:30,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,332 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:30,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,336 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,336 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,336 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:30,337 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:30,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:30,337 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,337 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,337 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:30,337 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:30,337 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:30,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:30,337 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:30,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:30,338 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:30,338 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:30,438 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:30,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:30,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:30,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:30,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,451 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:30,451 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:30,452 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-25 12:53:30,452 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-25 12:53:30,452 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,453 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,455 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:30,455 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:30,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:30,455 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,455 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:30,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:30,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,457 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,457 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-25 12:53:30,457 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,457 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-25 12:53:30,457 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:30,458 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-25 12:53:30,460 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:30,460 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:30,460 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:30,460 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. started... 2023-11-25 12:53:30,460 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ec2e29f51499fb50f28c15f7410a96e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:30,480 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010180ea97d8ece94607a87b5b7778d7cb4b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010180ea97d8ece94607a87b5b7778d7cb4b 2023-11-25 12:53:30,889 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/4ac3da6aa2cf44f7b5770d6e81d25bda 2023-11-25 12:53:30,897 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/4ac3da6aa2cf44f7b5770d6e81d25bda as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/4ac3da6aa2cf44f7b5770d6e81d25bda 2023-11-25 12:53:30,905 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/4ac3da6aa2cf44f7b5770d6e81d25bda, entries=1, sequenceid=29, filesize=5.0 K 2023-11-25 12:53:30,906 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ec2e29f51499fb50f28c15f7410a96e in 446ms, sequenceid=29, compaction requested=true 2023-11-25 12:53:30,906 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:30,907 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:30,907 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:30,907 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:30,907 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,907 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-25 12:53:30,907 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-25 12:53:30,912 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,912 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:30,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:30,913 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,913 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:30,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:30,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:30,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:30,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-25 12:53:30,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7adf7779[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:30,916 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-25 12:53:30,916 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,917 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,918 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-25 12:53:30,918 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-25 12:53:30,918 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:30,918 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,918 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:30,919 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,919 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-25 12:53:30,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,920 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:30,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:30,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:30,920 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-25 12:53:30,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:30,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:30,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:30,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:30,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-25 12:53:30,924 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-25 12:53:30,924 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:30,924 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:30,924 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,924 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:30,926 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,926 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,926 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:30,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:30,927 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:30,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,928 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:30,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,933 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,933 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:30,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:30,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:30,933 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:30,933 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:30,933 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:30,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:30,934 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-25 12:53:30,934 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:30,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:30,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:30,934 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,934 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,934 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:30,934 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:30,935 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:31,035 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:31,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:31,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:31,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:31,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,047 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:31,048 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:31,048 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-25 12:53:31,048 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-25 12:53:31,049 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,049 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,050 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,050 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:31,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:31,051 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,051 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,052 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,052 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-25 12:53:31,052 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,053 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-25 12:53:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-25 12:53:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:31,054 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:31,054 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. started... 2023-11-25 12:53:31,054 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ec2e29f51499fb50f28c15f7410a96e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:31,075 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103cc182c2d6743470e82aaeddf56a1bc4f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103cc182c2d6743470e82aaeddf56a1bc4f 2023-11-25 12:53:31,485 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/752166ed968547c69beea947d841cd6d 2023-11-25 12:53:31,494 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/752166ed968547c69beea947d841cd6d as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/752166ed968547c69beea947d841cd6d 2023-11-25 12:53:31,501 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/752166ed968547c69beea947d841cd6d, entries=1, sequenceid=33, filesize=5.0 K 2023-11-25 12:53:31,502 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ec2e29f51499fb50f28c15f7410a96e in 448ms, sequenceid=33, compaction requested=true 2023-11-25 12:53:31,502 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:31,502 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:31,502 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:31,503 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:31,503 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,503 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-25 12:53:31,503 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-25 12:53:31,505 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,505 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:31,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:31,505 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:31,505 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:31,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:31,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:31,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-25 12:53:31,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@486a5d43[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:31,507 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-25 12:53:31,507 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,509 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,509 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-25 12:53:31,509 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-25 12:53:31,509 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:31,509 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,509 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:31,512 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-25 12:53:31,512 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,512 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:31,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:31,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:31,512 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-25 12:53:31,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:31,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:31,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:31,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:31,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-25 12:53:31,516 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-25 12:53:31,516 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:31,517 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:31,517 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,517 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:31,519 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,519 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:31,519 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:31,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:31,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,520 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:31,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:31,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:31,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:31,522 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:31,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,525 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,525 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:31,525 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:31,525 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,525 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:31,525 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:31,525 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:31,526 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:31,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:31,526 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,527 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-25 12:53:31,527 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:31,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:31,527 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:31,527 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:31,627 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:31,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:31,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:31,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:31,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,639 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:31,639 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:31,639 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-25 12:53:31,639 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-25 12:53:31,640 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,640 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,642 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:31,642 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:31,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:31,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,642 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:31,642 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:31,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:31,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,643 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,643 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-25 12:53:31,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:31,643 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-25 12:53:31,643 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:31,644 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-25 12:53:31,644 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:31,644 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:31,644 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:31,644 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. started... 2023-11-25 12:53:31,644 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ec2e29f51499fb50f28c15f7410a96e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:32,068 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907871cce1366734857aadb0910128d7382 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907871cce1366734857aadb0910128d7382 2023-11-25 12:53:32,479 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/1c0f1c6fc24d4d6bb2a40f07c439be7d 2023-11-25 12:53:32,488 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/1c0f1c6fc24d4d6bb2a40f07c439be7d as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/1c0f1c6fc24d4d6bb2a40f07c439be7d 2023-11-25 12:53:32,495 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/1c0f1c6fc24d4d6bb2a40f07c439be7d, entries=1, sequenceid=37, filesize=5.0 K 2023-11-25 12:53:32,496 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ec2e29f51499fb50f28c15f7410a96e in 852ms, sequenceid=37, compaction requested=true 2023-11-25 12:53:32,496 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:32,496 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:32,496 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:32,497 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:32,497 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,497 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-25 12:53:32,497 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-25 12:53:32,499 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,499 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:32,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:32,499 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,499 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:32,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:32,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:32,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:32,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-25 12:53:32,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22c8e567[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:32,501 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-25 12:53:32,501 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,503 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,503 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-25 12:53:32,503 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-25 12:53:32,503 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:32,503 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,503 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:32,505 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,505 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-25 12:53:32,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:32,505 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:32,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:32,505 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-25 12:53:32,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:32,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:32,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:32,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:32,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-25 12:53:32,511 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-25 12:53:32,511 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:32,511 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:32,511 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,511 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:32,514 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,514 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:32,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:32,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,514 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:32,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:32,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:32,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:32,515 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:32,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,518 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:32,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,524 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,524 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:32,524 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:32,524 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:32,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-25 12:53:32,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:32,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:32,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:32,524 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:32,524 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,527 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,527 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,527 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,527 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,527 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:32,527 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:32,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:32,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:32,628 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:32,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:32,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:32,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:32,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,639 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:32,639 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:32,639 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-25 12:53:32,639 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-25 12:53:32,640 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,640 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,642 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:32,642 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:32,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:32,642 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:32,643 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:32,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:32,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,644 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,644 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-25 12:53:32,644 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:32,644 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-25 12:53:32,644 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:32,645 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-25 12:53:32,645 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:32,645 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:32,645 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:32,646 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. started... 2023-11-25 12:53:32,646 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ec2e29f51499fb50f28c15f7410a96e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:33,068 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112079330c3fd8c246ac8a281aa38b9ae3e9 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112079330c3fd8c246ac8a281aa38b9ae3e9 2023-11-25 12:53:33,478 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/f2816f2609434d199455d6888b4839b7 2023-11-25 12:53:33,486 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/f2816f2609434d199455d6888b4839b7 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/f2816f2609434d199455d6888b4839b7 2023-11-25 12:53:33,493 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/f2816f2609434d199455d6888b4839b7, entries=1, sequenceid=41, filesize=5.0 K 2023-11-25 12:53:33,495 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ec2e29f51499fb50f28c15f7410a96e in 849ms, sequenceid=41, compaction requested=true 2023-11-25 12:53:33,495 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:33,495 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:33,495 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:33,495 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:33,495 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:33,495 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-25 12:53:33,495 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-25 12:53:33,498 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:33,498 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:33,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:33,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:33,499 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,499 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:33,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:33,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:33,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:33,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:33,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-25 12:53:33,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f0bedd3[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:33,500 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-25 12:53:33,500 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,502 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,502 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-25 12:53:33,502 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-25 12:53:33,502 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:33,502 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:33,502 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:33,504 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:33,504 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-25 12:53:33,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:33,504 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:33,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:33,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:33,504 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-25 12:53:33,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:33,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:33,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:33,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:33,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:33,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:33,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-25 12:53:33,507 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-25 12:53:33,508 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:33,508 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:33,508 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,508 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:33,510 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,510 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:33,510 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:33,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:33,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,510 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:33,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:33,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:33,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:33,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:33,512 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:33,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:33,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:33,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:33,517 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:33,517 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,517 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,517 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:33,517 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,517 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,517 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,517 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:33,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-25 12:53:33,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:33,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:33,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:33,517 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:33,517 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:33,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-25 12:53:33,518 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:33,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:33,518 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:33,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:33,618 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:33,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:33,625 DEBUG [Listener at localhost/45289] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-25 12:53:33,628 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-25 12:53:33,629 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38201] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:33,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-25 12:53:33,644 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-25 12:53:33,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:53:33,646 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700917413646 2023-11-25 12:53:33,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-25 12:53:33,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-25 12:53:33,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-25 12:53:33,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] zookeeper.ReadOnlyZKClient(139): Connect 0x7f955da9 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:53:33,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@576d9306, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:53:33,659 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:34,534 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a2cd3e0a1ba0453fa3280de3b7a8bbc0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103a2cd3e0a1ba0453fa3280de3b7a8bbc0 2023-11-25 12:53:34,536 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-25 12:53:34,557 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:53:34,558 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:53:34,570 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:53:34,571 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:53:34,605 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c5af6bbebfa54fe78bce32e443542755 first=Optional[r3] last=Optional[r6] 2023-11-25 12:53:34,618 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c5af6bbebfa54fe78bce32e443542755}] 2023-11-25 12:53:34,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c5af6bbebfa54fe78bce32e443542755 for inclusion in 1ec2e29f51499fb50f28c15f7410a96e/family1 2023-11-25 12:53:34,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-25 12:53:34,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:53:34,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:34,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c5af6bbebfa54fe78bce32e443542755 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__u1sk7p889usvo9mmr9m251886243bfm73uqcedgeh6rqohq88qi2r77cqefqqpmo/family1/c5af6bbebfa54fe78bce32e443542755 2023-11-25 12:53:34,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__u1sk7p889usvo9mmr9m251886243bfm73uqcedgeh6rqohq88qi2r77cqefqqpmo/family1/c5af6bbebfa54fe78bce32e443542755 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/30dc1481d948495bab40b3df1786629a_SeqId_44_ 2023-11-25 12:53:34,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__u1sk7p889usvo9mmr9m251886243bfm73uqcedgeh6rqohq88qi2r77cqefqqpmo/family1/c5af6bbebfa54fe78bce32e443542755 into 1ec2e29f51499fb50f28c15f7410a96e/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/30dc1481d948495bab40b3df1786629a_SeqId_44_ - updating store file list. 2023-11-25 12:53:34,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/30dc1481d948495bab40b3df1786629a_SeqId_44_ into 1ec2e29f51499fb50f28c15f7410a96e/family1 2023-11-25 12:53:34,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__u1sk7p889usvo9mmr9m251886243bfm73uqcedgeh6rqohq88qi2r77cqefqqpmo/family1/c5af6bbebfa54fe78bce32e443542755 into 1ec2e29f51499fb50f28c15f7410a96e/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/30dc1481d948495bab40b3df1786629a_SeqId_44_) 2023-11-25 12:53:34,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__u1sk7p889usvo9mmr9m251886243bfm73uqcedgeh6rqohq88qi2r77cqefqqpmo/family1/c5af6bbebfa54fe78bce32e443542755 2023-11-25 12:53:34,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-25 12:53:34,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-25 12:53:34,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(1912): 1ec2e29f51499fb50f28c15f7410a96e/family1 is initiating minor compaction 2023-11-25 12:53:34,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@19011d9f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:53:34,667 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1ec2e29f51499fb50f28c15f7410a96e/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:34,667 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/63d5a01ddf264601a6e8192377ad0246, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/624ab53c7796441b951bc64258cc3f83, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/e21ba85ef85043eb8c36946e85c25193, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/d8ef0a2f96e245d8b94ba723e7e7a033, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/feb14cf305a44ecdb0b19e9b3f223657, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/4ac3da6aa2cf44f7b5770d6e81d25bda, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/752166ed968547c69beea947d841cd6d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/1c0f1c6fc24d4d6bb2a40f07c439be7d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/f2816f2609434d199455d6888b4839b7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/30dc1481d948495bab40b3df1786629a_SeqId_44_] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp, totalSize=50.2 K 2023-11-25 12:53:34,668 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 63d5a01ddf264601a6e8192377ad0246, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-25 12:53:34,668 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 624ab53c7796441b951bc64258cc3f83, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-25 12:53:34,668 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting e21ba85ef85043eb8c36946e85c25193, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-25 12:53:34,668 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting d8ef0a2f96e245d8b94ba723e7e7a033, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-25 12:53:34,668 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting feb14cf305a44ecdb0b19e9b3f223657, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-25 12:53:34,668 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 4ac3da6aa2cf44f7b5770d6e81d25bda, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-25 12:53:34,668 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 752166ed968547c69beea947d841cd6d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-25 12:53:34,668 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 1c0f1c6fc24d4d6bb2a40f07c439be7d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-25 12:53:34,668 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting f2816f2609434d199455d6888b4839b7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-25 12:53:34,668 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 30dc1481d948495bab40b3df1786629a_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-25 12:53:34,683 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-25 12:53:34,684 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:53:34,690 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512289680cf3ddaf44a5498a7646cda5f81e0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512289680cf3ddaf44a5498a7646cda5f81e0 2023-11-25 12:53:34,692 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512318df4560f027a4c7cb0ca3cc78bd80508 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512318df4560f027a4c7cb0ca3cc78bd80508 2023-11-25 12:53:34,694 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010180ea97d8ece94607a87b5b7778d7cb4b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010180ea97d8ece94607a87b5b7778d7cb4b 2023-11-25 12:53:34,696 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103cc182c2d6743470e82aaeddf56a1bc4f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103cc182c2d6743470e82aaeddf56a1bc4f 2023-11-25 12:53:34,696 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-25 12:53:34,696 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-25 12:53:34,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:34,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:34,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:34,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:34,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:34,698 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:34,698 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:34,698 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:34,728 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1ec2e29f51499fb50f28c15f7410a96e#family1#compaction#10 average throughput is 0.48 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:53:35,163 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/eb73c218b323456ea62d92187c0752e0 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/eb73c218b323456ea62d92187c0752e0 2023-11-25 12:53:35,182 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1ec2e29f51499fb50f28c15f7410a96e/family1 of 1ec2e29f51499fb50f28c15f7410a96e into eb73c218b323456ea62d92187c0752e0(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:53:35,183 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:35,185 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1700916814664; duration=0sec 2023-11-25 12:53:35,186 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:53:35,262 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/63d5a01ddf264601a6e8192377ad0246, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/624ab53c7796441b951bc64258cc3f83, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/e21ba85ef85043eb8c36946e85c25193, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/d8ef0a2f96e245d8b94ba723e7e7a033, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/feb14cf305a44ecdb0b19e9b3f223657, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/4ac3da6aa2cf44f7b5770d6e81d25bda, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/752166ed968547c69beea947d841cd6d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/1c0f1c6fc24d4d6bb2a40f07c439be7d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/f2816f2609434d199455d6888b4839b7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/30dc1481d948495bab40b3df1786629a_SeqId_44_] to archive 2023-11-25 12:53:35,264 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:53:35,266 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/63d5a01ddf264601a6e8192377ad0246 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/63d5a01ddf264601a6e8192377ad0246 2023-11-25 12:53:35,268 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/624ab53c7796441b951bc64258cc3f83 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/624ab53c7796441b951bc64258cc3f83 2023-11-25 12:53:35,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/e21ba85ef85043eb8c36946e85c25193 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/e21ba85ef85043eb8c36946e85c25193 2023-11-25 12:53:35,271 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/d8ef0a2f96e245d8b94ba723e7e7a033 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/d8ef0a2f96e245d8b94ba723e7e7a033 2023-11-25 12:53:35,272 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/feb14cf305a44ecdb0b19e9b3f223657 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/feb14cf305a44ecdb0b19e9b3f223657 2023-11-25 12:53:35,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/4ac3da6aa2cf44f7b5770d6e81d25bda to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/4ac3da6aa2cf44f7b5770d6e81d25bda 2023-11-25 12:53:35,275 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/752166ed968547c69beea947d841cd6d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/752166ed968547c69beea947d841cd6d 2023-11-25 12:53:35,277 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/1c0f1c6fc24d4d6bb2a40f07c439be7d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/1c0f1c6fc24d4d6bb2a40f07c439be7d 2023-11-25 12:53:35,279 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/f2816f2609434d199455d6888b4839b7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/f2816f2609434d199455d6888b4839b7 2023-11-25 12:53:35,280 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/30dc1481d948495bab40b3df1786629a_SeqId_44_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/30dc1481d948495bab40b3df1786629a_SeqId_44_ 2023-11-25 12:53:35,593 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058b4e1d2cb50e424da84adb97a3541728 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512058b4e1d2cb50e424da84adb97a3541728 2023-11-25 12:53:35,594 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-25 12:53:35,631 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b091b728f4ac41359bafabde4876f964 first=Optional[r00] last=Optional[r2] 2023-11-25 12:53:35,632 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b091b728f4ac41359bafabde4876f964}] 2023-11-25 12:53:35,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b091b728f4ac41359bafabde4876f964 for inclusion in 1ec2e29f51499fb50f28c15f7410a96e/family1 2023-11-25 12:53:35,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-25 12:53:35,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:53:35,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:35,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b091b728f4ac41359bafabde4876f964 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__60leahk836ttvsv4d98idh3og5b2lt09dnluoh6arlfhvrh58qm1d95qnscne992/family1/b091b728f4ac41359bafabde4876f964 2023-11-25 12:53:35,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__60leahk836ttvsv4d98idh3og5b2lt09dnluoh6arlfhvrh58qm1d95qnscne992/family1/b091b728f4ac41359bafabde4876f964 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/a0443a4c51524579865019fa106dcb34_SeqId_47_ 2023-11-25 12:53:35,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__60leahk836ttvsv4d98idh3og5b2lt09dnluoh6arlfhvrh58qm1d95qnscne992/family1/b091b728f4ac41359bafabde4876f964 into 1ec2e29f51499fb50f28c15f7410a96e/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/a0443a4c51524579865019fa106dcb34_SeqId_47_ - updating store file list. 2023-11-25 12:53:35,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/a0443a4c51524579865019fa106dcb34_SeqId_47_ into 1ec2e29f51499fb50f28c15f7410a96e/family1 2023-11-25 12:53:35,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__60leahk836ttvsv4d98idh3og5b2lt09dnluoh6arlfhvrh58qm1d95qnscne992/family1/b091b728f4ac41359bafabde4876f964 into 1ec2e29f51499fb50f28c15f7410a96e/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/a0443a4c51524579865019fa106dcb34_SeqId_47_) 2023-11-25 12:53:35,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__60leahk836ttvsv4d98idh3og5b2lt09dnluoh6arlfhvrh58qm1d95qnscne992/family1/b091b728f4ac41359bafabde4876f964 2023-11-25 12:53:35,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-25 12:53:35,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-25 12:53:35,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(1912): 1ec2e29f51499fb50f28c15f7410a96e/family1 is initiating minor compaction (all files) 2023-11-25 12:53:35,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4d67034b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:53:35,656 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1ec2e29f51499fb50f28c15f7410a96e/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:35,657 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/5b30ef0416eb42b58cbc82c3c9da754e, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/eb73c218b323456ea62d92187c0752e0, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/a0443a4c51524579865019fa106dcb34_SeqId_47_] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp, totalSize=358.6 K 2023-11-25 12:53:35,658 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 5b30ef0416eb42b58cbc82c3c9da754e, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878825182 2023-11-25 12:53:35,658 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting eb73c218b323456ea62d92187c0752e0, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621225182 2023-11-25 12:53:35,659 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting a0443a4c51524579865019fa106dcb34_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878825182 2023-11-25 12:53:35,660 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-25 12:53:35,662 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:53:35,665 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511304adc1c9c1df64ae98a59793f20ea0135 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511304adc1c9c1df64ae98a59793f20ea0135 2023-11-25 12:53:35,667 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120159f5818996434bcf92ff889910d5be0b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120159f5818996434bcf92ff889910d5be0b 2023-11-25 12:53:35,669 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120581da5932cf46405b940fb0a64950c497 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120581da5932cf46405b940fb0a64950c497 2023-11-25 12:53:35,669 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-25 12:53:35,669 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-25 12:53:35,670 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:35,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-25 12:53:35,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:53:35,672 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-25 12:53:35,674 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.0360 sec 2023-11-25 12:53:35,699 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1ec2e29f51499fb50f28c15f7410a96e#family1#compaction#11 average throughput is 7.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:53:35,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-25 12:53:35,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:35,870 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-25 12:53:35,872 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-25 12:53:35,873 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-25 12:53:35,878 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-25 12:53:35,894 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1ec2e29f51499fb50f28c15f7410a96e, REOPEN/MOVE}] 2023-11-25 12:53:35,895 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1ec2e29f51499fb50f28c15f7410a96e, REOPEN/MOVE 2023-11-25 12:53:35,896 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1ec2e29f51499fb50f28c15f7410a96e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:35,897 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700916815896"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916815896"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916815896"}]},"ts":"1700916815896"} 2023-11-25 12:53:35,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 1ec2e29f51499fb50f28c15f7410a96e, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:53:36,058 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:36,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:36,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1ec2e29f51499fb50f28c15f7410a96e, disabling compactions & flushes 2023-11-25 12:53:36,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:36,536 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/.tmp/family1/494c4aecea344f9cb7e0bf7c78306fca as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/494c4aecea344f9cb7e0bf7c78306fca 2023-11-25 12:53:36,543 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1ec2e29f51499fb50f28c15f7410a96e/family1 of 1ec2e29f51499fb50f28c15f7410a96e into 494c4aecea344f9cb7e0bf7c78306fca(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:53:36,543 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:36,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:36,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:36,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. after waiting 0 ms 2023-11-25 12:53:36,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:36,544 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1700916815656; duration=0sec 2023-11-25 12:53:36,544 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:53:36,546 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/5b30ef0416eb42b58cbc82c3c9da754e, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/eb73c218b323456ea62d92187c0752e0, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/a0443a4c51524579865019fa106dcb34_SeqId_47_] to archive 2023-11-25 12:53:36,547 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:53:36,550 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/5b30ef0416eb42b58cbc82c3c9da754e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/5b30ef0416eb42b58cbc82c3c9da754e 2023-11-25 12:53:36,551 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/eb73c218b323456ea62d92187c0752e0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/eb73c218b323456ea62d92187c0752e0 2023-11-25 12:53:36,553 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/a0443a4c51524579865019fa106dcb34_SeqId_47_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/a0443a4c51524579865019fa106dcb34_SeqId_47_ 2023-11-25 12:53:36,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-25 12:53:36,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:36,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:36,560 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: 1ec2e29f51499fb50f28c15f7410a96e to self. 2023-11-25 12:53:36,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:36,563 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1ec2e29f51499fb50f28c15f7410a96e, regionState=CLOSED 2023-11-25 12:53:36,563 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700916816562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916816562"}]},"ts":"1700916816562"} 2023-11-25 12:53:36,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=16, resume processing ppid=15 2023-11-25 12:53:36,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 1ec2e29f51499fb50f28c15f7410a96e, server=jenkins-hbase4.apache.org,37051,1700916801082 in 665 msec 2023-11-25 12:53:36,568 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1ec2e29f51499fb50f28c15f7410a96e, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=true 2023-11-25 12:53:36,718 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1ec2e29f51499fb50f28c15f7410a96e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:36,718 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700916816718"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916816718"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916816718"}]},"ts":"1700916816718"} 2023-11-25 12:53:36,721 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 1ec2e29f51499fb50f28c15f7410a96e, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:53:36,873 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:36,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:36,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ec2e29f51499fb50f28c15f7410a96e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:53:36,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:36,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:53:36,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:36,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:36,880 INFO [StoreOpener-1ec2e29f51499fb50f28c15f7410a96e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:36,882 DEBUG [StoreOpener-1ec2e29f51499fb50f28c15f7410a96e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1 2023-11-25 12:53:36,882 DEBUG [StoreOpener-1ec2e29f51499fb50f28c15f7410a96e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1 2023-11-25 12:53:36,882 INFO [StoreOpener-1ec2e29f51499fb50f28c15f7410a96e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec2e29f51499fb50f28c15f7410a96e columnFamilyName family1 2023-11-25 12:53:36,891 DEBUG [StoreOpener-1ec2e29f51499fb50f28c15f7410a96e-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/494c4aecea344f9cb7e0bf7c78306fca 2023-11-25 12:53:36,891 INFO [StoreOpener-1ec2e29f51499fb50f28c15f7410a96e-1] regionserver.HStore(310): Store=1ec2e29f51499fb50f28c15f7410a96e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:53:36,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:36,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:36,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:53:36,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1ec2e29f51499fb50f28c15f7410a96e; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73913401, jitterRate=0.10139550268650055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-25 12:53:36,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:36,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e., pid=17, masterSystemTime=1700916816873 2023-11-25 12:53:36,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:36,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:53:36,903 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1ec2e29f51499fb50f28c15f7410a96e, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:36,904 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700916816903"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916816903"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916816903"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916816903"}]},"ts":"1700916816903"} 2023-11-25 12:53:36,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=17, resume processing ppid=15 2023-11-25 12:53:36,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 1ec2e29f51499fb50f28c15f7410a96e, server=jenkins-hbase4.apache.org,37051,1700916801082 in 185 msec 2023-11-25 12:53:36,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=15, resume processing ppid=14 2023-11-25 12:53:36,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1ec2e29f51499fb50f28c15f7410a96e, REOPEN/MOVE in 1.0140 sec 2023-11-25 12:53:36,914 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=14, resume processing ppid=13 2023-11-25 12:53:36,914 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0360 sec 2023-11-25 12:53:36,916 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0640 sec 2023-11-25 12:53:36,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-25 12:53:36,927 INFO [Listener at localhost/45289] compactions.TestMobCompactor(278): alter status finished 2023-11-25 12:53:36,928 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38201] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-25 12:53:36,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-25 12:53:36,930 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-25 12:53:36,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:53:36,932 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700917416931 2023-11-25 12:53:36,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-25 12:53:36,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-25 12:53:36,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-25 12:53:36,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] zookeeper.ReadOnlyZKClient(139): Connect 0x0f7e3ffe to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:53:36,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60409cfe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:53:36,944 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:36,944 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:36,944 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:36,944 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:36,944 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:37,382 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112873fd7c94ea7141cfa1ecf56572662465 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112873fd7c94ea7141cfa1ecf56572662465 2023-11-25 12:53:37,383 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-25 12:53:37,397 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:53:37,398 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:53:37,407 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:53:37,409 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:53:37,421 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9253d3e5d9cd41c08f97c12281b7a519 first=Optional[r05] last=Optional[r8] 2023-11-25 12:53:37,421 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=51 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9253d3e5d9cd41c08f97c12281b7a519}] 2023-11-25 12:53:37,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9253d3e5d9cd41c08f97c12281b7a519 for inclusion in 1ec2e29f51499fb50f28c15f7410a96e/family1 2023-11-25 12:53:37,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-25 12:53:37,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:53:37,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:53:37,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9253d3e5d9cd41c08f97c12281b7a519 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__38rhs1b82qq4mo32966dtphtf73odmvbv2hfnnpvg4ss22klc1278ed60hvl2vfk/family1/9253d3e5d9cd41c08f97c12281b7a519 2023-11-25 12:53:37,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__38rhs1b82qq4mo32966dtphtf73odmvbv2hfnnpvg4ss22klc1278ed60hvl2vfk/family1/9253d3e5d9cd41c08f97c12281b7a519 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/9afb56b072a24fd4a3ac61de2ea8a9ef_SeqId_53_ 2023-11-25 12:53:37,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__38rhs1b82qq4mo32966dtphtf73odmvbv2hfnnpvg4ss22klc1278ed60hvl2vfk/family1/9253d3e5d9cd41c08f97c12281b7a519 into 1ec2e29f51499fb50f28c15f7410a96e/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/9afb56b072a24fd4a3ac61de2ea8a9ef_SeqId_53_ - updating store file list. 2023-11-25 12:53:37,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/9afb56b072a24fd4a3ac61de2ea8a9ef_SeqId_53_ into 1ec2e29f51499fb50f28c15f7410a96e/family1 2023-11-25 12:53:37,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__38rhs1b82qq4mo32966dtphtf73odmvbv2hfnnpvg4ss22klc1278ed60hvl2vfk/family1/9253d3e5d9cd41c08f97c12281b7a519 into 1ec2e29f51499fb50f28c15f7410a96e/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/family1/9afb56b072a24fd4a3ac61de2ea8a9ef_SeqId_53_) 2023-11-25 12:53:37,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__38rhs1b82qq4mo32966dtphtf73odmvbv2hfnnpvg4ss22klc1278ed60hvl2vfk/family1/9253d3e5d9cd41c08f97c12281b7a519 2023-11-25 12:53:37,444 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-25 12:53:37,445 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:53:37,447 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112079330c3fd8c246ac8a281aa38b9ae3e9 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112079330c3fd8c246ac8a281aa38b9ae3e9 2023-11-25 12:53:37,448 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112880de0d69be1b42e490adc224ff9f66b2 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112880de0d69be1b42e490adc224ff9f66b2 2023-11-25 12:53:37,448 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-25 12:53:37,449 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-25 12:53:37,449 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:37,449 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:37,449 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-25 12:53:37,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-25 12:53:37,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:53:37,450 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-25 12:53:37,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 522 msec 2023-11-25 12:53:37,538 INFO [Listener at localhost/45289] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=252 (was 213) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:52172 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:52334 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63200@0x7f955da9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1831122238.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:52350 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:52378 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2879c8e7-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:52304 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2879c8e7-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/cluster_099e5cbf-51cd-003d-9e5e-00eb47e6e9bf/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:37051-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:50200 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:52182 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:52298 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5739c92c-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2879c8e7-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:52320 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:52228 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5739c92c-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2879c8e7-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:52372 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63200@0x0f7e3ffe-SendThread(127.0.0.1:63200) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63200@0x7f955da9-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_630303918_17 at /127.0.0.1:52200 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5739c92c-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63200@0x0f7e3ffe-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63200@0x7f955da9-SendThread(127.0.0.1:63200) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: hconnection-0x2879c8e7-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:52302 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:52190 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:52286 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63200@0x0f7e3ffe sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1831122238.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=621 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=310 (was 318), ProcessCount=170 (was 171), AvailableMemoryMB=8315 (was 8362) 2023-11-25 12:53:37,554 INFO [Listener at localhost/45289] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=252, OpenFileDescriptor=621, MaxFileDescriptor=60000, SystemLoadAverage=310, ProcessCount=170, AvailableMemoryMB=8314 2023-11-25 12:53:37,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-25 12:53:37,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:37,559 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-25 12:53:37,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-25 12:53:37,560 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-25 12:53:37,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-25 12:53:37,562 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff 2023-11-25 12:53:37,562 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff empty. 2023-11-25 12:53:37,563 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff 2023-11-25 12:53:37,563 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-25 12:53:37,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-25 12:53:37,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-25 12:53:37,974 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-25 12:53:37,976 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => b24fcdd00cf9bdd24601c4776c94f7ff, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:53:38,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-25 12:53:38,383 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:53:38,383 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing b24fcdd00cf9bdd24601c4776c94f7ff, disabling compactions & flushes 2023-11-25 12:53:38,383 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:38,383 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:38,383 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. after waiting 0 ms 2023-11-25 12:53:38,383 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:38,383 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:38,383 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:38,387 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-25 12:53:38,388 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700916818388"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916818388"}]},"ts":"1700916818388"} 2023-11-25 12:53:38,390 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-25 12:53:38,391 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-25 12:53:38,391 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916818391"}]},"ts":"1700916818391"} 2023-11-25 12:53:38,392 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-25 12:53:38,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=b24fcdd00cf9bdd24601c4776c94f7ff, ASSIGN}] 2023-11-25 12:53:38,397 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=b24fcdd00cf9bdd24601c4776c94f7ff, ASSIGN 2023-11-25 12:53:38,398 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=b24fcdd00cf9bdd24601c4776c94f7ff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:53:38,549 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b24fcdd00cf9bdd24601c4776c94f7ff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:38,550 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700916818549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916818549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916818549"}]},"ts":"1700916818549"} 2023-11-25 12:53:38,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure b24fcdd00cf9bdd24601c4776c94f7ff, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:53:38,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-25 12:53:38,704 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:38,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:38,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b24fcdd00cf9bdd24601c4776c94f7ff, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff.', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:53:38,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy b24fcdd00cf9bdd24601c4776c94f7ff 2023-11-25 12:53:38,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:53:38,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b24fcdd00cf9bdd24601c4776c94f7ff 2023-11-25 12:53:38,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b24fcdd00cf9bdd24601c4776c94f7ff 2023-11-25 12:53:38,710 INFO [StoreOpener-b24fcdd00cf9bdd24601c4776c94f7ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b24fcdd00cf9bdd24601c4776c94f7ff 2023-11-25 12:53:38,712 DEBUG [StoreOpener-b24fcdd00cf9bdd24601c4776c94f7ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1 2023-11-25 12:53:38,712 DEBUG [StoreOpener-b24fcdd00cf9bdd24601c4776c94f7ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1 2023-11-25 12:53:38,713 INFO [StoreOpener-b24fcdd00cf9bdd24601c4776c94f7ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b24fcdd00cf9bdd24601c4776c94f7ff columnFamilyName family1 2023-11-25 12:53:38,714 INFO [StoreOpener-b24fcdd00cf9bdd24601c4776c94f7ff-1] regionserver.HStore(310): Store=b24fcdd00cf9bdd24601c4776c94f7ff/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:53:38,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff 2023-11-25 12:53:38,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff 2023-11-25 12:53:38,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b24fcdd00cf9bdd24601c4776c94f7ff 2023-11-25 12:53:38,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:53:38,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b24fcdd00cf9bdd24601c4776c94f7ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71264462, jitterRate=0.06192323565483093}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-25 12:53:38,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:38,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff., pid=21, masterSystemTime=1700916818704 2023-11-25 12:53:38,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:38,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:38,725 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b24fcdd00cf9bdd24601c4776c94f7ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:38,726 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700916818725"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916818725"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916818725"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916818725"}]},"ts":"1700916818725"} 2023-11-25 12:53:38,730 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=21, resume processing ppid=20 2023-11-25 12:53:38,730 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure b24fcdd00cf9bdd24601c4776c94f7ff, server=jenkins-hbase4.apache.org,37051,1700916801082 in 176 msec 2023-11-25 12:53:38,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=20, resume processing ppid=19 2023-11-25 12:53:38,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=b24fcdd00cf9bdd24601c4776c94f7ff, ASSIGN in 334 msec 2023-11-25 12:53:38,733 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-25 12:53:38,734 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916818734"}]},"ts":"1700916818734"} 2023-11-25 12:53:38,735 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-25 12:53:38,738 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-25 12:53:38,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1820 sec 2023-11-25 12:53:39,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-25 12:53:39,667 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-25 12:53:39,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:39,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:39,708 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:39,708 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:39,709 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:53:39,709 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:39,709 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:39,709 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:39,712 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:39,712 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:39,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:39,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:39,712 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:39,712 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:39,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:39,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:39,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:39,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:39,714 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:39,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:39,715 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:53:39,715 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:39,715 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:53:39,716 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:39,716 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:39,716 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:39,716 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. started... 2023-11-25 12:53:39,716 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b24fcdd00cf9bdd24601c4776c94f7ff 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-25 12:53:40,146 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f530367219a048fea3e964d4771292a8 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130f530367219a048fea3e964d4771292a8 2023-11-25 12:53:40,551 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/a9ad861ffb4d428fad78b55de81df6da 2023-11-25 12:53:40,559 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/a9ad861ffb4d428fad78b55de81df6da as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/a9ad861ffb4d428fad78b55de81df6da 2023-11-25 12:53:40,565 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/a9ad861ffb4d428fad78b55de81df6da, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-25 12:53:40,567 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for b24fcdd00cf9bdd24601c4776c94f7ff in 851ms, sequenceid=5, compaction requested=false 2023-11-25 12:53:40,567 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:40,567 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:40,567 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:40,567 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:40,567 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:40,567 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,568 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:53:40,568 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:53:40,570 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:40,570 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:40,571 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,571 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:40,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:40,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:40,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:53:40,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5eee2df4[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:40,573 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:40,573 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,574 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,574 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:40,574 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:53:40,574 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:40,574 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,574 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:40,576 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,576 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:53:40,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:40,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:40,576 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:40,576 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:53:40,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:40,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:40,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:40,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:40,580 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:53:40,580 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:40,580 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:40,580 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,580 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:40,582 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,582 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:40,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,583 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:40,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:40,583 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,585 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,593 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,593 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:40,593 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:40,593 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,594 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,593 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:40,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-25 12:53:40,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:40,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:40,594 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:40,594 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:40,594 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,595 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,595 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:40,595 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:40,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:40,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:40,695 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:40,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:40,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:40,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:40,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,703 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:40,703 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:40,704 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:53:40,704 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:40,705 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,705 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,706 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:40,706 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:40,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:40,707 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,707 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:40,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,707 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,708 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:53:40,708 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:40,708 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:53:40,708 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:40,708 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:53:40,708 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:40,708 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:40,708 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:40,709 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. started... 2023-11-25 12:53:40,709 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b24fcdd00cf9bdd24601c4776c94f7ff 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-25 12:53:41,124 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112847a1bb00aa144fe0b91b24d0870e4918 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112847a1bb00aa144fe0b91b24d0870e4918 2023-11-25 12:53:41,531 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/96a560ad0d8d48d9a4456991362f5383 2023-11-25 12:53:41,538 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/96a560ad0d8d48d9a4456991362f5383 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/96a560ad0d8d48d9a4456991362f5383 2023-11-25 12:53:41,544 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/96a560ad0d8d48d9a4456991362f5383, entries=1, sequenceid=9, filesize=5.0 K 2023-11-25 12:53:41,545 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for b24fcdd00cf9bdd24601c4776c94f7ff in 836ms, sequenceid=9, compaction requested=false 2023-11-25 12:53:41,545 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:41,545 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:41,545 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:41,545 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:41,545 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,545 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:53:41,545 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:53:41,549 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,549 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:41,549 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,549 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:41,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:41,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:41,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:53:41,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44f4e32f[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:41,551 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:41,551 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,552 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,553 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:41,553 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:53:41,553 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:41,553 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,553 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:41,555 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:53:41,555 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,555 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:41,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,555 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:53:41,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:41,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:41,558 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:53:41,558 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:41,558 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:41,559 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,559 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:41,561 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:41,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:41,561 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,561 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:41,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:41,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:41,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:41,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,565 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:41,566 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,570 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,571 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:41,571 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,571 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:41,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:41,571 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,571 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,571 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,571 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,571 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:41,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:41,571 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:41,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:41,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:41,572 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:41,572 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:41,672 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:41,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:41,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:41,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:41,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,681 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:41,681 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:41,681 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:53:41,681 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:41,682 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,682 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,683 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,683 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:41,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:41,684 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:41,684 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,685 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,685 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:53:41,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:41,686 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:53:41,686 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:41,686 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:53:41,686 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:41,687 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:41,687 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:41,687 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. started... 2023-11-25 12:53:41,687 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b24fcdd00cf9bdd24601c4776c94f7ff 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:41,702 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201bb0ba8ef201e4ef1ad19723b3174da06 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201bb0ba8ef201e4ef1ad19723b3174da06 2023-11-25 12:53:42,098 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-25 12:53:42,109 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/c8ab28e62191491596c92153c3df962f 2023-11-25 12:53:42,121 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/c8ab28e62191491596c92153c3df962f as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/c8ab28e62191491596c92153c3df962f 2023-11-25 12:53:42,128 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/c8ab28e62191491596c92153c3df962f, entries=1, sequenceid=13, filesize=4.9 K 2023-11-25 12:53:42,129 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b24fcdd00cf9bdd24601c4776c94f7ff in 442ms, sequenceid=13, compaction requested=true 2023-11-25 12:53:42,129 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:42,129 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:42,129 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:42,129 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:42,129 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,129 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:53:42,129 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:53:42,131 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,131 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:42,132 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:42,132 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:42,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:42,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:53:42,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21f2c50b[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:42,134 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:42,134 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,135 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,135 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:42,135 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:53:42,135 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:42,135 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,136 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:42,138 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:53:42,138 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:42,138 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,138 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:53:42,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:42,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:42,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:42,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:42,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:42,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:42,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:42,141 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:53:42,142 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:42,142 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:42,142 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,142 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:42,144 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,144 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,144 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:42,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:42,145 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,146 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,149 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,149 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,149 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,149 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:42,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:42,149 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:42,149 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:42,149 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:42,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:42,149 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,149 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:42,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:42,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:42,150 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,151 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:42,151 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:42,251 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:42,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:42,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:42,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:42,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,259 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:42,259 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:42,260 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:53:42,260 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:42,260 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,260 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,262 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:42,262 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:42,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:42,262 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:42,263 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:42,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:42,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,263 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,264 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:53:42,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:42,264 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:53:42,264 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:42,264 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:53:42,265 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:42,265 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:42,265 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:42,265 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. started... 2023-11-25 12:53:42,265 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b24fcdd00cf9bdd24601c4776c94f7ff 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:42,681 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120506c5e04586174829b518445206906d19 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120506c5e04586174829b518445206906d19 2023-11-25 12:53:43,088 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/9f2944521ee74765825af5a8870e6526 2023-11-25 12:53:43,096 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/9f2944521ee74765825af5a8870e6526 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/9f2944521ee74765825af5a8870e6526 2023-11-25 12:53:43,102 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/9f2944521ee74765825af5a8870e6526, entries=1, sequenceid=17, filesize=4.9 K 2023-11-25 12:53:43,103 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b24fcdd00cf9bdd24601c4776c94f7ff in 838ms, sequenceid=17, compaction requested=true 2023-11-25 12:53:43,103 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:43,103 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:43,103 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:43,103 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:43,104 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,104 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:53:43,104 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:53:43,217 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,217 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:43,217 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,217 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:43,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:53:43,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2117d193[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:43,219 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:43,219 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,324 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,324 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:43,324 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:53:43,324 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:43,325 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,325 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:43,524 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:53:43,524 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,524 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:43,524 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:53:43,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:43,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:43,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:43,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:43,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:43,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:43,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:43,528 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:53:43,528 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:43,528 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:43,528 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,528 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:43,601 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,601 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:43,601 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:43,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:43,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:43,602 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:43,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,603 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:43,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,647 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,647 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:43,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:43,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:43,647 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,647 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:43,648 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:43,647 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:43,649 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:43,648 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,649 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:43,649 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,649 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,649 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:43,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:43,749 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:43,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:43,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:43,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:43,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,757 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:43,757 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:43,758 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:53:43,758 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:43,759 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,759 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,770 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:43,770 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:43,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:43,771 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:43,771 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:43,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:43,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,772 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,772 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:53:43,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:43,772 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:53:43,772 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:43,772 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:53:43,773 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:43,773 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:43,773 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:43,773 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. started... 2023-11-25 12:53:43,773 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b24fcdd00cf9bdd24601c4776c94f7ff 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:44,189 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122882cedd08402c49c18d8d470e3f460c0e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122882cedd08402c49c18d8d470e3f460c0e 2023-11-25 12:53:44,194 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/17a71bbc47cc4d3792a184a28eb427e2 2023-11-25 12:53:44,200 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/17a71bbc47cc4d3792a184a28eb427e2 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/17a71bbc47cc4d3792a184a28eb427e2 2023-11-25 12:53:44,205 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/17a71bbc47cc4d3792a184a28eb427e2, entries=1, sequenceid=21, filesize=4.9 K 2023-11-25 12:53:44,206 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b24fcdd00cf9bdd24601c4776c94f7ff in 433ms, sequenceid=21, compaction requested=true 2023-11-25 12:53:44,206 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:44,206 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:44,206 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:44,206 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:44,206 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,206 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:53:44,206 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:53:44,208 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,208 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:44,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:44,209 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,209 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:44,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:44,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:44,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:44,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:53:44,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eb9c9c8[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:44,211 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:44,211 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,212 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,213 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:44,213 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:53:44,213 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:44,213 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,213 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:44,214 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:53:44,215 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,215 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:44,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:44,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:44,215 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:53:44,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:44,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:44,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:44,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:44,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:44,218 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:53:44,218 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:44,218 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:44,218 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,218 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:44,221 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,221 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:44,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:44,221 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:44,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:44,222 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:44,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:44,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:44,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,223 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:44,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,226 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,226 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:44,226 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:44,226 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:44,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:44,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:44,226 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:44,226 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,226 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:44,226 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-25 12:53:44,227 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,227 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:44,227 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:44,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:44,227 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:44,327 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:44,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:44,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:44,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:44,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,336 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:44,336 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:44,337 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:53:44,337 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:44,337 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,337 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,339 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:44,339 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:44,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:44,340 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:44,340 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:44,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:44,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,341 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,341 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:53:44,341 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:44,341 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:53:44,341 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:44,342 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:53:44,342 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:44,342 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:44,342 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:44,342 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. started... 2023-11-25 12:53:44,342 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b24fcdd00cf9bdd24601c4776c94f7ff 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:44,758 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123122864594d48c4cd4b34a8602466a7ba0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123122864594d48c4cd4b34a8602466a7ba0 2023-11-25 12:53:45,164 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/cac01eefb82c49d183930105ca16f0c3 2023-11-25 12:53:45,172 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/cac01eefb82c49d183930105ca16f0c3 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/cac01eefb82c49d183930105ca16f0c3 2023-11-25 12:53:45,178 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/cac01eefb82c49d183930105ca16f0c3, entries=1, sequenceid=25, filesize=4.9 K 2023-11-25 12:53:45,179 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b24fcdd00cf9bdd24601c4776c94f7ff in 837ms, sequenceid=25, compaction requested=true 2023-11-25 12:53:45,179 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:45,179 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:53:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:53:45,181 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,181 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:45,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:45,182 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,182 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:45,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:45,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:45,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:45,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:53:45,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d37aeab[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:45,183 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:45,183 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,186 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:53:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:45,186 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,186 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:45,188 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:53:45,188 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,188 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:45,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:45,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:45,188 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:53:45,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:45,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:45,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:45,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:45,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:45,191 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:53:45,191 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:45,191 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:45,191 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,191 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:45,193 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,193 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:45,193 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,194 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:45,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,195 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,198 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,198 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,198 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:45,198 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:45,198 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:45,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:45,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:45,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-25 12:53:45,198 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:45,198 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:45,199 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:45,199 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,200 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:45,200 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:45,200 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,300 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:45,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:45,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:45,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:45,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,309 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:45,309 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:45,309 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:53:45,309 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:45,310 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,310 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,313 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:45,313 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:45,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:45,313 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,314 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:45,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:45,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,315 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,315 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:53:45,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,315 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:53:45,315 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:45,315 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:53:45,316 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:45,316 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:45,316 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:45,316 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. started... 2023-11-25 12:53:45,316 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b24fcdd00cf9bdd24601c4776c94f7ff 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:45,336 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101115e9b2ed80e4b319b6008ab663346e3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101115e9b2ed80e4b319b6008ab663346e3 2023-11-25 12:53:45,742 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/76e5db61cbba43b199f6d2eb2880b3b1 2023-11-25 12:53:45,749 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/76e5db61cbba43b199f6d2eb2880b3b1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/76e5db61cbba43b199f6d2eb2880b3b1 2023-11-25 12:53:45,755 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/76e5db61cbba43b199f6d2eb2880b3b1, entries=1, sequenceid=29, filesize=4.9 K 2023-11-25 12:53:45,756 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b24fcdd00cf9bdd24601c4776c94f7ff in 440ms, sequenceid=29, compaction requested=true 2023-11-25 12:53:45,757 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:45,757 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:45,757 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:45,757 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:45,757 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,757 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:53:45,757 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:53:45,762 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,762 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:45,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:45,762 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,762 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:45,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:53:45,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a5af49b[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:45,764 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:45,764 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,766 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,766 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:45,766 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:53:45,766 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:45,766 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,766 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:45,768 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:53:45,768 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,768 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:45,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:45,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:45,768 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:53:45,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:45,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:45,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:45,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:45,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:45,771 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:53:45,771 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:45,772 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:45,772 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,772 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:45,773 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,774 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:45,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,774 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:45,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:45,774 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:45,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,776 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:45,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,779 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,780 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,780 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,780 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,780 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,780 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,780 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,780 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:45,780 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:45,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-25 12:53:45,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:45,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:45,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:45,780 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:45,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:45,781 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:45,781 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:45,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:45,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:45,881 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:45,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:45,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:45,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:45,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,891 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:45,891 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:45,892 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:53:45,892 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:45,892 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,892 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,894 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:45,894 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:45,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:45,894 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,894 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,896 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,896 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:53:45,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,896 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:53:45,896 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:45,896 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:53:45,897 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:45,897 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:45,897 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:45,897 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. started... 2023-11-25 12:53:45,897 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b24fcdd00cf9bdd24601c4776c94f7ff 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:45,919 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039f74d42313ae4fd79a569961e6472c0c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601039f74d42313ae4fd79a569961e6472c0c 2023-11-25 12:53:45,926 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/b6a3242ae9c24199ba82bff3cc17d946 2023-11-25 12:53:45,931 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/b6a3242ae9c24199ba82bff3cc17d946 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/b6a3242ae9c24199ba82bff3cc17d946 2023-11-25 12:53:45,935 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/b6a3242ae9c24199ba82bff3cc17d946, entries=1, sequenceid=33, filesize=4.9 K 2023-11-25 12:53:45,936 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b24fcdd00cf9bdd24601c4776c94f7ff in 39ms, sequenceid=33, compaction requested=true 2023-11-25 12:53:45,937 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:45,937 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:45,937 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:45,937 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:45,937 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,937 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:53:45,937 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:53:45,939 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,939 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:45,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:45,939 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,939 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:45,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:45,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:45,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:45,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:53:45,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45de2d0a[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:45,941 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:45,941 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,942 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,943 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:45,943 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:53:45,943 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:45,943 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,943 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:45,945 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:53:45,945 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:45,945 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,945 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:53:45,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:45,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:45,948 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:53:45,948 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:45,948 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:45,948 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,948 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:45,950 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,950 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:45,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,950 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:45,951 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:45,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,952 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:45,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,955 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,955 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,955 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:45,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:45,955 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:45,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-25 12:53:45,955 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:45,955 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:45,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:45,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:45,956 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:45,956 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,956 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:45,956 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,956 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:45,956 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:45,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:45,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:46,057 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:46,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:46,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:46,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:46,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,064 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:46,064 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:46,065 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:53:46,065 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:46,065 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,065 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,067 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:46,067 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:46,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:46,067 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,067 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,068 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,069 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:53:46,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,069 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:53:46,069 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:46,069 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:53:46,069 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:46,069 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:46,069 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:46,070 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. started... 2023-11-25 12:53:46,070 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b24fcdd00cf9bdd24601c4776c94f7ff 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:46,488 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509076e7b03737dc3424c8f81ec1c8d16f279 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509076e7b03737dc3424c8f81ec1c8d16f279 2023-11-25 12:53:46,494 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/cfff5e615b354fb695b49b745df5e101 2023-11-25 12:53:46,499 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/cfff5e615b354fb695b49b745df5e101 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/cfff5e615b354fb695b49b745df5e101 2023-11-25 12:53:46,503 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/cfff5e615b354fb695b49b745df5e101, entries=1, sequenceid=37, filesize=4.9 K 2023-11-25 12:53:46,504 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b24fcdd00cf9bdd24601c4776c94f7ff in 434ms, sequenceid=37, compaction requested=true 2023-11-25 12:53:46,505 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:46,505 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:46,505 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:46,505 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:46,505 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,505 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:53:46,505 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:53:46,508 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,508 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:46,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:46,508 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,508 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:46,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:46,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:53:46,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5695bf0[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:46,510 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:46,510 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,511 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,511 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:46,512 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:53:46,511 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,512 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:46,512 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:46,513 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,513 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:53:46,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:46,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:46,513 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:46,514 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:53:46,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:46,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:46,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:46,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:46,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:46,517 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:53:46,517 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:46,517 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:46,517 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,517 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:46,519 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,519 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:46,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:46,519 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:46,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:46,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:46,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:46,520 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:46,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,521 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:46,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,527 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,528 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,528 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:46,528 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:46,528 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,528 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:46,528 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:46,528 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-25 12:53:46,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:46,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:46,528 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:46,529 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,529 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,529 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:46,530 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:46,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:46,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:46,630 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:46,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:46,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:46,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:46,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,637 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:46,637 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:46,638 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:53:46,638 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:46,638 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,638 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,640 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:46,640 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:46,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:46,640 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:46,641 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:46,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:46,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,641 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,642 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:53:46,642 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:46,642 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:53:46,642 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:46,643 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:53:46,643 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:46,643 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:46,643 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:46,643 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. started... 2023-11-25 12:53:46,643 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b24fcdd00cf9bdd24601c4776c94f7ff 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:47,059 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120f246d31e9ffd4987af04c32f6226f70f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120f246d31e9ffd4987af04c32f6226f70f 2023-11-25 12:53:47,465 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/42cf82616b674224a11d921d7f0d8b4d 2023-11-25 12:53:47,471 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/42cf82616b674224a11d921d7f0d8b4d as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/42cf82616b674224a11d921d7f0d8b4d 2023-11-25 12:53:47,476 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/42cf82616b674224a11d921d7f0d8b4d, entries=1, sequenceid=41, filesize=4.9 K 2023-11-25 12:53:47,477 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b24fcdd00cf9bdd24601c4776c94f7ff in 834ms, sequenceid=41, compaction requested=true 2023-11-25 12:53:47,477 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:47,477 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:47,477 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:47,477 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:47,477 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:47,477 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:53:47,477 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:53:47,479 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:47,479 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:47,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:47,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:47,479 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,479 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:47,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:47,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:47,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:47,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:47,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:53:47,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@557bef00[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:47,481 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:47,481 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,482 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,482 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:47,483 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:53:47,483 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:47,483 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:47,483 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:47,485 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:47,485 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:53:47,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:47,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:47,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:47,485 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:47,485 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:53:47,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:47,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:47,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:47,487 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:53:47,487 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:47,487 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:47,487 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,488 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:47,489 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,489 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,489 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:47,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:47,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:47,490 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,491 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:47,494 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:47,494 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,494 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,494 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:47,494 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,494 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:47,494 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,494 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:47,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-25 12:53:47,494 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-25 12:53:47,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:47,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:47,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:47,494 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:47,495 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:47,495 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:47,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:47,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:47,595 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:47,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:47,598 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38201] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-25 12:53:47,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-25 12:53:47,601 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-25 12:53:47,602 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700917427601 2023-11-25 12:53:47,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:53:47,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-25 12:53:47,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-25 12:53:47,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:53:47,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] zookeeper.ReadOnlyZKClient(139): Connect 0x773e7e14 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:53:47,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13fdab61, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:53:47,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:53:47,644 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030cc06f309ea04b489dff357f3a778ecc to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030cc06f309ea04b489dff357f3a778ecc 2023-11-25 12:53:47,645 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:53:47,665 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:53:47,666 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:53:47,674 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:53:47,675 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:53:47,686 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/86731a5a7d9e465d877d087fbccd2790 first=Optional[r5] last=Optional[r6] 2023-11-25 12:53:47,686 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/86731a5a7d9e465d877d087fbccd2790}] 2023-11-25 12:53:47,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/86731a5a7d9e465d877d087fbccd2790 for inclusion in b24fcdd00cf9bdd24601c4776c94f7ff/family1 2023-11-25 12:53:47,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-25 12:53:47,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:53:47,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:47,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/86731a5a7d9e465d877d087fbccd2790 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__6j6s6fjdf1jq93c62d2dd32b8m5n3h314qbmm5na4tc2be4umk3dgmnbd2mhpqqi/family1/86731a5a7d9e465d877d087fbccd2790 2023-11-25 12:53:47,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__6j6s6fjdf1jq93c62d2dd32b8m5n3h314qbmm5na4tc2be4umk3dgmnbd2mhpqqi/family1/86731a5a7d9e465d877d087fbccd2790 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/2735c702a2a84a14895fa915b31c3bfc_SeqId_44_ 2023-11-25 12:53:47,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__6j6s6fjdf1jq93c62d2dd32b8m5n3h314qbmm5na4tc2be4umk3dgmnbd2mhpqqi/family1/86731a5a7d9e465d877d087fbccd2790 into b24fcdd00cf9bdd24601c4776c94f7ff/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/2735c702a2a84a14895fa915b31c3bfc_SeqId_44_ - updating store file list. 2023-11-25 12:53:47,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/2735c702a2a84a14895fa915b31c3bfc_SeqId_44_ into b24fcdd00cf9bdd24601c4776c94f7ff/family1 2023-11-25 12:53:47,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__6j6s6fjdf1jq93c62d2dd32b8m5n3h314qbmm5na4tc2be4umk3dgmnbd2mhpqqi/family1/86731a5a7d9e465d877d087fbccd2790 into b24fcdd00cf9bdd24601c4776c94f7ff/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/2735c702a2a84a14895fa915b31c3bfc_SeqId_44_) 2023-11-25 12:53:47,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__6j6s6fjdf1jq93c62d2dd32b8m5n3h314qbmm5na4tc2be4umk3dgmnbd2mhpqqi/family1/86731a5a7d9e465d877d087fbccd2790 2023-11-25 12:53:47,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-25 12:53:47,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-25 12:53:47,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(1912): b24fcdd00cf9bdd24601c4776c94f7ff/family1 is initiating minor compaction 2023-11-25 12:53:47,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5d428820; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:53:47,712 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b24fcdd00cf9bdd24601c4776c94f7ff/family1 in testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:53:47,712 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/96a560ad0d8d48d9a4456991362f5383, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/c8ab28e62191491596c92153c3df962f, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/9f2944521ee74765825af5a8870e6526, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/17a71bbc47cc4d3792a184a28eb427e2, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/cac01eefb82c49d183930105ca16f0c3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/76e5db61cbba43b199f6d2eb2880b3b1, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/b6a3242ae9c24199ba82bff3cc17d946, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/cfff5e615b354fb695b49b745df5e101, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/42cf82616b674224a11d921d7f0d8b4d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/2735c702a2a84a14895fa915b31c3bfc_SeqId_44_] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp, totalSize=49.7 K 2023-11-25 12:53:47,712 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 96a560ad0d8d48d9a4456991362f5383, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-25 12:53:47,713 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting c8ab28e62191491596c92153c3df962f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-25 12:53:47,713 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 9f2944521ee74765825af5a8870e6526, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-25 12:53:47,713 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 17a71bbc47cc4d3792a184a28eb427e2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-25 12:53:47,713 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting cac01eefb82c49d183930105ca16f0c3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-25 12:53:47,713 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 76e5db61cbba43b199f6d2eb2880b3b1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-25 12:53:47,713 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting b6a3242ae9c24199ba82bff3cc17d946, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-25 12:53:47,713 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting cfff5e615b354fb695b49b745df5e101, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-25 12:53:47,713 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 42cf82616b674224a11d921d7f0d8b4d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-25 12:53:47,713 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 2735c702a2a84a14895fa915b31c3bfc_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-25 12:53:47,714 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:53:47,715 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:53:47,717 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101115e9b2ed80e4b319b6008ab663346e3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101115e9b2ed80e4b319b6008ab663346e3 2023-11-25 12:53:47,718 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601039f74d42313ae4fd79a569961e6472c0c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601039f74d42313ae4fd79a569961e6472c0c 2023-11-25 12:53:47,718 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-25 12:53:47,718 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-25 12:53:47,719 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:53:47,719 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:53:47,766 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): b24fcdd00cf9bdd24601c4776c94f7ff#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:53:48,192 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310f31a147b05c40158c721f7786695098 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512310f31a147b05c40158c721f7786695098 2023-11-25 12:53:48,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:53:48,219 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d0f35cf2b61c492d93ab4d74c255e04e first=Optional[r1] last=Optional[r4] 2023-11-25 12:53:48,220 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d0f35cf2b61c492d93ab4d74c255e04e}] 2023-11-25 12:53:48,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d0f35cf2b61c492d93ab4d74c255e04e for inclusion in b24fcdd00cf9bdd24601c4776c94f7ff/family1 2023-11-25 12:53:48,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-25 12:53:48,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:53:48,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:48,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d0f35cf2b61c492d93ab4d74c255e04e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__j3j0mrt812k6knrsph8biqc17g58e9dribv96qldoeubbkvv1ak24nnsqbaop3mj/family1/d0f35cf2b61c492d93ab4d74c255e04e 2023-11-25 12:53:48,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__j3j0mrt812k6knrsph8biqc17g58e9dribv96qldoeubbkvv1ak24nnsqbaop3mj/family1/d0f35cf2b61c492d93ab4d74c255e04e as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/2c95367d88964b0b8420e6acc797545b_SeqId_46_ 2023-11-25 12:53:48,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__j3j0mrt812k6knrsph8biqc17g58e9dribv96qldoeubbkvv1ak24nnsqbaop3mj/family1/d0f35cf2b61c492d93ab4d74c255e04e into b24fcdd00cf9bdd24601c4776c94f7ff/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/2c95367d88964b0b8420e6acc797545b_SeqId_46_ - updating store file list. 2023-11-25 12:53:48,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/2c95367d88964b0b8420e6acc797545b_SeqId_46_ into b24fcdd00cf9bdd24601c4776c94f7ff/family1 2023-11-25 12:53:48,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__j3j0mrt812k6knrsph8biqc17g58e9dribv96qldoeubbkvv1ak24nnsqbaop3mj/family1/d0f35cf2b61c492d93ab4d74c255e04e into b24fcdd00cf9bdd24601c4776c94f7ff/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/2c95367d88964b0b8420e6acc797545b_SeqId_46_) 2023-11-25 12:53:48,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__j3j0mrt812k6knrsph8biqc17g58e9dribv96qldoeubbkvv1ak24nnsqbaop3mj/family1/d0f35cf2b61c492d93ab4d74c255e04e 2023-11-25 12:53:48,237 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:53:48,238 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:53:48,239 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201bb0ba8ef201e4ef1ad19723b3174da06 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201bb0ba8ef201e4ef1ad19723b3174da06 2023-11-25 12:53:48,241 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120506c5e04586174829b518445206906d19 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120506c5e04586174829b518445206906d19 2023-11-25 12:53:48,242 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122882cedd08402c49c18d8d470e3f460c0e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122882cedd08402c49c18d8d470e3f460c0e 2023-11-25 12:53:48,243 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123122864594d48c4cd4b34a8602466a7ba0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123122864594d48c4cd4b34a8602466a7ba0 2023-11-25 12:53:48,243 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-25 12:53:48,243 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-25 12:53:48,244 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:53:48,244 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:53:48,289 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511309d8979c406664dae9d191a0392068556 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511309d8979c406664dae9d191a0392068556 2023-11-25 12:53:48,290 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:53:48,320 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/68ed73ec7fd346fe8a9716392cd332b6 first=Optional[r00] last=Optional[r8] 2023-11-25 12:53:48,321 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/68ed73ec7fd346fe8a9716392cd332b6}] 2023-11-25 12:53:48,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/68ed73ec7fd346fe8a9716392cd332b6 for inclusion in b24fcdd00cf9bdd24601c4776c94f7ff/family1 2023-11-25 12:53:48,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-25 12:53:48,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:53:48,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:48,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/68ed73ec7fd346fe8a9716392cd332b6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uv5lvo3u1vk3t9n9gtta5ojgscp0ofv18bm7aurrveucvqkmii44gbsfb6kamf4l/family1/68ed73ec7fd346fe8a9716392cd332b6 2023-11-25 12:53:48,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uv5lvo3u1vk3t9n9gtta5ojgscp0ofv18bm7aurrveucvqkmii44gbsfb6kamf4l/family1/68ed73ec7fd346fe8a9716392cd332b6 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/4b0bcdba4f71490b9bda5bd53fa08fb0_SeqId_48_ 2023-11-25 12:53:48,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uv5lvo3u1vk3t9n9gtta5ojgscp0ofv18bm7aurrveucvqkmii44gbsfb6kamf4l/family1/68ed73ec7fd346fe8a9716392cd332b6 into b24fcdd00cf9bdd24601c4776c94f7ff/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/4b0bcdba4f71490b9bda5bd53fa08fb0_SeqId_48_ - updating store file list. 2023-11-25 12:53:48,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/4b0bcdba4f71490b9bda5bd53fa08fb0_SeqId_48_ into b24fcdd00cf9bdd24601c4776c94f7ff/family1 2023-11-25 12:53:48,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uv5lvo3u1vk3t9n9gtta5ojgscp0ofv18bm7aurrveucvqkmii44gbsfb6kamf4l/family1/68ed73ec7fd346fe8a9716392cd332b6 into b24fcdd00cf9bdd24601c4776c94f7ff/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/4b0bcdba4f71490b9bda5bd53fa08fb0_SeqId_48_) 2023-11-25 12:53:48,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uv5lvo3u1vk3t9n9gtta5ojgscp0ofv18bm7aurrveucvqkmii44gbsfb6kamf4l/family1/68ed73ec7fd346fe8a9716392cd332b6 2023-11-25 12:53:48,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.SortedCompactionPolicy(75): Selecting compaction from 13 store files, 10 compacting, 2 eligible, 16 blocking 2023-11-25 12:53:48,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-25 12:53:48,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-25 12:53:48,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.CompactSplit(415): Not compacting testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. because compaction request was cancelled 2023-11-25 12:53:48,342 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:53:48,342 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:53:48,344 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120f246d31e9ffd4987af04c32f6226f70f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120f246d31e9ffd4987af04c32f6226f70f 2023-11-25 12:53:48,345 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112847a1bb00aa144fe0b91b24d0870e4918 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112847a1bb00aa144fe0b91b24d0870e4918 2023-11-25 12:53:48,347 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130f530367219a048fea3e964d4771292a8 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130f530367219a048fea3e964d4771292a8 2023-11-25 12:53:48,347 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-25 12:53:48,347 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-25 12:53:48,347 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:53:48,347 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:53:48,347 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:53:48,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:53:48,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:53:48,348 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-25 12:53:48,350 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 750 msec 2023-11-25 12:53:48,463 INFO [Listener at localhost/45289] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=266 (was 252) Potentially hanging thread: hconnection-0x25615df8-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:38962 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63200@0x773e7e14-SendThread(127.0.0.1:63200) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63200@0x773e7e14 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1831122238.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/cea0b62ca9c34161ade6117888619641 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39166 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39192 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39060 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39138 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25615df8-shared-pool-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xa14609b-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39226 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39212 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39180 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39264 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xa14609b-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39160 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39170 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39022 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/cluster_099e5cbf-51cd-003d-9e5e-00eb47e6e9bf/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xa14609b-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39122 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25615df8-shared-pool-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39094 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39174 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xa14609b-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39236 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39188 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63200@0x773e7e14-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: hconnection-0xa14609b-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_630303918_17 at /127.0.0.1:39248 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39120 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xa14609b-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xa14609b-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:38996 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1812928918_17 at /127.0.0.1:39206 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=661 (was 621) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 310), ProcessCount=170 (was 170), AvailableMemoryMB=8302 (was 8314) 2023-11-25 12:53:48,474 INFO [Listener at localhost/45289] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=266, OpenFileDescriptor=661, MaxFileDescriptor=60000, SystemLoadAverage=278, ProcessCount=170, AvailableMemoryMB=8301 2023-11-25 12:53:48,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-25 12:53:48,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:48,479 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-25 12:53:48,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-25 12:53:48,480 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-25 12:53:48,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-25 12:53:48,481 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39 2023-11-25 12:53:48,482 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39 empty. 2023-11-25 12:53:48,483 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39 2023-11-25 12:53:48,483 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-25 12:53:48,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-25 12:53:48,596 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/.tmp/family1/cea0b62ca9c34161ade6117888619641 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/cea0b62ca9c34161ade6117888619641 2023-11-25 12:53:48,602 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in b24fcdd00cf9bdd24601c4776c94f7ff/family1 of b24fcdd00cf9bdd24601c4776c94f7ff into cea0b62ca9c34161ade6117888619641(size=6.6 K), total size for store is 344.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:53:48,602 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:53:48,602 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700916827712; duration=0sec 2023-11-25 12:53:48,602 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:53:48,671 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/96a560ad0d8d48d9a4456991362f5383, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/c8ab28e62191491596c92153c3df962f, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/9f2944521ee74765825af5a8870e6526, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/17a71bbc47cc4d3792a184a28eb427e2, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/cac01eefb82c49d183930105ca16f0c3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/76e5db61cbba43b199f6d2eb2880b3b1, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/b6a3242ae9c24199ba82bff3cc17d946, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/cfff5e615b354fb695b49b745df5e101, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/42cf82616b674224a11d921d7f0d8b4d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/2735c702a2a84a14895fa915b31c3bfc_SeqId_44_] to archive 2023-11-25 12:53:48,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:53:48,675 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/96a560ad0d8d48d9a4456991362f5383 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/96a560ad0d8d48d9a4456991362f5383 2023-11-25 12:53:48,676 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/c8ab28e62191491596c92153c3df962f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/c8ab28e62191491596c92153c3df962f 2023-11-25 12:53:48,677 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/9f2944521ee74765825af5a8870e6526 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/9f2944521ee74765825af5a8870e6526 2023-11-25 12:53:48,679 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/17a71bbc47cc4d3792a184a28eb427e2 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/17a71bbc47cc4d3792a184a28eb427e2 2023-11-25 12:53:48,680 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/cac01eefb82c49d183930105ca16f0c3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/cac01eefb82c49d183930105ca16f0c3 2023-11-25 12:53:48,681 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/76e5db61cbba43b199f6d2eb2880b3b1 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/76e5db61cbba43b199f6d2eb2880b3b1 2023-11-25 12:53:48,682 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/b6a3242ae9c24199ba82bff3cc17d946 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/b6a3242ae9c24199ba82bff3cc17d946 2023-11-25 12:53:48,683 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/cfff5e615b354fb695b49b745df5e101 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/cfff5e615b354fb695b49b745df5e101 2023-11-25 12:53:48,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/42cf82616b674224a11d921d7f0d8b4d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/42cf82616b674224a11d921d7f0d8b4d 2023-11-25 12:53:48,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/2735c702a2a84a14895fa915b31c3bfc_SeqId_44_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/family1/2735c702a2a84a14895fa915b31c3bfc_SeqId_44_ 2023-11-25 12:53:48,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-25 12:53:48,894 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-25 12:53:48,895 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 27807dc9fc4b004f8aed835c4201af39, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:53:49,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-25 12:53:49,303 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:53:49,303 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 27807dc9fc4b004f8aed835c4201af39, disabling compactions & flushes 2023-11-25 12:53:49,303 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:49,303 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:49,303 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. after waiting 0 ms 2023-11-25 12:53:49,303 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:49,303 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:49,303 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:53:49,306 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-25 12:53:49,307 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700916829307"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916829307"}]},"ts":"1700916829307"} 2023-11-25 12:53:49,309 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-25 12:53:49,310 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-25 12:53:49,310 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916829310"}]},"ts":"1700916829310"} 2023-11-25 12:53:49,312 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-25 12:53:49,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=27807dc9fc4b004f8aed835c4201af39, ASSIGN}] 2023-11-25 12:53:49,317 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=27807dc9fc4b004f8aed835c4201af39, ASSIGN 2023-11-25 12:53:49,318 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=27807dc9fc4b004f8aed835c4201af39, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:53:49,469 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=27807dc9fc4b004f8aed835c4201af39, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:49,469 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700916829469"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916829469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916829469"}]},"ts":"1700916829469"} 2023-11-25 12:53:49,471 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 27807dc9fc4b004f8aed835c4201af39, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:53:49,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-25 12:53:49,623 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:49,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:49,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 27807dc9fc4b004f8aed835c4201af39, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39.', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:53:49,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 27807dc9fc4b004f8aed835c4201af39 2023-11-25 12:53:49,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:53:49,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 27807dc9fc4b004f8aed835c4201af39 2023-11-25 12:53:49,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 27807dc9fc4b004f8aed835c4201af39 2023-11-25 12:53:49,629 INFO [StoreOpener-27807dc9fc4b004f8aed835c4201af39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 27807dc9fc4b004f8aed835c4201af39 2023-11-25 12:53:49,630 DEBUG [StoreOpener-27807dc9fc4b004f8aed835c4201af39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1 2023-11-25 12:53:49,631 DEBUG [StoreOpener-27807dc9fc4b004f8aed835c4201af39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1 2023-11-25 12:53:49,631 INFO [StoreOpener-27807dc9fc4b004f8aed835c4201af39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27807dc9fc4b004f8aed835c4201af39 columnFamilyName family1 2023-11-25 12:53:49,633 INFO [StoreOpener-27807dc9fc4b004f8aed835c4201af39-1] regionserver.HStore(310): Store=27807dc9fc4b004f8aed835c4201af39/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:53:49,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39 2023-11-25 12:53:49,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39 2023-11-25 12:53:49,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 27807dc9fc4b004f8aed835c4201af39 2023-11-25 12:53:49,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:53:49,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 27807dc9fc4b004f8aed835c4201af39; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75342457, jitterRate=0.1226900964975357}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-25 12:53:49,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:53:49,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39., pid=25, masterSystemTime=1700916829623 2023-11-25 12:53:49,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:49,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:49,643 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=27807dc9fc4b004f8aed835c4201af39, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:49,643 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700916829643"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916829643"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916829643"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916829643"}]},"ts":"1700916829643"} 2023-11-25 12:53:49,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=25, resume processing ppid=24 2023-11-25 12:53:49,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 27807dc9fc4b004f8aed835c4201af39, server=jenkins-hbase4.apache.org,37051,1700916801082 in 174 msec 2023-11-25 12:53:49,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=24, resume processing ppid=23 2023-11-25 12:53:49,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=27807dc9fc4b004f8aed835c4201af39, ASSIGN in 332 msec 2023-11-25 12:53:49,651 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-25 12:53:49,651 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916829651"}]},"ts":"1700916829651"} 2023-11-25 12:53:49,652 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-25 12:53:49,655 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-25 12:53:49,657 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1780 sec 2023-11-25 12:53:50,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-25 12:53:50,587 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-25 12:53:50,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:50,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:50,610 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:50,610 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:50,610 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:53:50,610 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:50,611 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:50,611 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:50,613 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:50,613 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:50,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:50,613 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:50,614 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:50,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:50,614 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:50,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:50,615 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:53:50,615 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:50,615 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:53:50,615 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:50,615 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:50,615 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:50,615 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. started... 2023-11-25 12:53:50,616 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27807dc9fc4b004f8aed835c4201af39 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-25 12:53:51,039 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c66f22190e2e4b009f4ef194a0779896 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130c66f22190e2e4b009f4ef194a0779896 2023-11-25 12:53:51,443 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/ac9a0b3585df4ca6beb7ab1508ae876f 2023-11-25 12:53:51,449 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/ac9a0b3585df4ca6beb7ab1508ae876f as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/ac9a0b3585df4ca6beb7ab1508ae876f 2023-11-25 12:53:51,454 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/ac9a0b3585df4ca6beb7ab1508ae876f, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-25 12:53:51,456 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 27807dc9fc4b004f8aed835c4201af39 in 839ms, sequenceid=5, compaction requested=false 2023-11-25 12:53:51,456 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:51,457 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:53:51,457 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:51,457 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:51,457 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:51,457 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,457 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:53:51,457 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:53:51,459 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,459 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:51,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:51,459 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,459 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:51,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:51,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:51,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:51,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:53:51,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58083718[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:51,461 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:51,461 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,462 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,463 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:51,463 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:53:51,463 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:51,463 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,463 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:51,465 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:53:51,465 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,465 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:51,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:51,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:51,465 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:53:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:51,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:51,468 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:53:51,468 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:51,468 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:51,468 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,468 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:51,471 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,471 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:51,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,471 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:51,471 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:51,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:51,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:51,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,473 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:51,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,476 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,476 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:51,476 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:51,476 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:51,476 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:51,476 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-25 12:53:51,476 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:51,476 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:51,477 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:51,477 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,477 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,477 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:51,477 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:51,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:51,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:51,577 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:51,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:51,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:51,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:51,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,585 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:51,585 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:51,585 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:53:51,585 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:51,586 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,586 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,588 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,588 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:51,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:51,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:51,588 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:51,588 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:51,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,589 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,589 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:53:51,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:51,590 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:53:51,590 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:51,590 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:53:51,590 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:51,590 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:51,590 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:51,590 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. started... 2023-11-25 12:53:51,590 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27807dc9fc4b004f8aed835c4201af39 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-25 12:53:51,606 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112872215581d0804ff2a5f12ada98900f32 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015112872215581d0804ff2a5f12ada98900f32 2023-11-25 12:53:52,015 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/169d36293def42e1bfcc7cedfa365e92 2023-11-25 12:53:52,021 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/169d36293def42e1bfcc7cedfa365e92 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/169d36293def42e1bfcc7cedfa365e92 2023-11-25 12:53:52,026 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/169d36293def42e1bfcc7cedfa365e92, entries=1, sequenceid=9, filesize=5.0 K 2023-11-25 12:53:52,027 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 27807dc9fc4b004f8aed835c4201af39 in 437ms, sequenceid=9, compaction requested=false 2023-11-25 12:53:52,027 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:53:52,027 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:52,027 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:52,027 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:52,027 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,027 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:53:52,027 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:53:52,037 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,037 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:52,037 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,038 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:52,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:53:52,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c0ae76e[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:52,039 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:52,039 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,040 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,041 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:52,041 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:53:52,041 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:52,041 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,041 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:52,042 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:53:52,042 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:52,042 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,042 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:53:52,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:52,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:52,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:52,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:52,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:52,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:52,045 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:53:52,045 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:52,045 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:52,045 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,045 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:52,047 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,047 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:52,047 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:52,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:52,048 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,049 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:52,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,052 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,053 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:52,053 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:52,053 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,053 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:52,053 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:52,053 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:52,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:52,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:52,053 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,053 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,053 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,053 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:52,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:52,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:52,053 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:52,154 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:52,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:52,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:52,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:52,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,161 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:52,161 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:52,161 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:53:52,161 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:52,162 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,162 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,163 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,163 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:52,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:52,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:52,164 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,164 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:52,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:52,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,165 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,165 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:53:52,165 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:52,165 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:53:52,165 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:52,165 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:53:52,165 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:52,165 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:52,166 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:52,166 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. started... 2023-11-25 12:53:52,166 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27807dc9fc4b004f8aed835c4201af39 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:52,581 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ddeb400c93b045d294f268fe94d6340c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201ddeb400c93b045d294f268fe94d6340c 2023-11-25 12:53:52,987 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/da968bf0685348bb989a2c105113ef34 2023-11-25 12:53:52,993 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/da968bf0685348bb989a2c105113ef34 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/da968bf0685348bb989a2c105113ef34 2023-11-25 12:53:52,997 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/da968bf0685348bb989a2c105113ef34, entries=1, sequenceid=13, filesize=4.9 K 2023-11-25 12:53:52,998 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27807dc9fc4b004f8aed835c4201af39 in 832ms, sequenceid=13, compaction requested=true 2023-11-25 12:53:52,998 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:53:52,999 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:52,999 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:52,999 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:52,999 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:52,999 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:53:52,999 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:53:53,001 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,001 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:53,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:53,001 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,001 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:53,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:53,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:53:53,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23f387c4[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:53,003 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:53,003 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,004 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,004 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:53,004 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:53:53,005 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:53,005 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,005 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:53,008 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:53:53,008 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,008 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:53,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:53,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:53,008 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:53:53,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:53,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:53,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:53,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:53,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:53,010 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:53:53,010 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:53,010 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:53,010 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,011 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:53,012 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,012 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:53,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:53,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,012 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:53,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:53,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:53,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:53,013 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,015 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:53,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,017 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,017 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:53,017 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:53,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:53,017 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:53,017 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:53,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:53,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:53,017 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,018 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,018 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,018 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,018 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:53,018 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:53,018 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:53,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:53,118 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:53,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:53,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:53,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:53,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,126 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:53,126 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:53,126 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:53:53,126 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:53,127 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,127 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,129 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,129 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:53,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:53,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:53,129 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,129 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:53,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,130 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,130 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:53:53,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,130 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:53:53,130 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:53,131 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:53:53,131 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:53,131 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:53,131 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:53,131 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. started... 2023-11-25 12:53:53,131 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27807dc9fc4b004f8aed835c4201af39 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:53,151 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e9933169e1e64a1392f84a6f96e748ad to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205e9933169e1e64a1392f84a6f96e748ad 2023-11-25 12:53:53,157 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/d25f2dc7afed4e35aee08239da298c61 2023-11-25 12:53:53,162 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/d25f2dc7afed4e35aee08239da298c61 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/d25f2dc7afed4e35aee08239da298c61 2023-11-25 12:53:53,167 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/d25f2dc7afed4e35aee08239da298c61, entries=1, sequenceid=17, filesize=4.9 K 2023-11-25 12:53:53,168 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27807dc9fc4b004f8aed835c4201af39 in 37ms, sequenceid=17, compaction requested=true 2023-11-25 12:53:53,168 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:53:53,168 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:53,168 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:53,168 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:53,168 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,169 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:53:53,169 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:53:53,173 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,173 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:53,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:53,174 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,174 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:53,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:53,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:53,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:53,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:53:53,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@297a6f55[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:53,176 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:53,176 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,177 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,177 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:53,177 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:53:53,177 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:53,177 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,178 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:53,179 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:53:53,179 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,179 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:53,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:53,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:53,179 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:53:53,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:53,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:53,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:53,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:53,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:53,182 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:53:53,182 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:53,182 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:53,182 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,182 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:53,184 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,184 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:53,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:53,184 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:53,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:53,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:53,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:53,184 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:53,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,186 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:53,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,191 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,191 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:53,191 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:53,192 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:53,191 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:53,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:53,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:53,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:53,192 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,192 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,192 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,192 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,192 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,192 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:53,192 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:53,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:53,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:53,292 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:53,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:53,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:53,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:53,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,300 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:53,300 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:53,300 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:53:53,300 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:53,301 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,301 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,302 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,302 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:53,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:53,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:53,303 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,303 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:53,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:53,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,304 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,304 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:53:53,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,304 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:53:53,304 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:53,304 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:53:53,304 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:53,304 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:53,304 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:53,304 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. started... 2023-11-25 12:53:53,304 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27807dc9fc4b004f8aed835c4201af39 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:53,318 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228b0ee16ea91984d9da9779485656d06e7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228b0ee16ea91984d9da9779485656d06e7 2023-11-25 12:53:53,725 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/8edf1c0b51a44635b62e36fe2b2df59d 2023-11-25 12:53:53,731 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/8edf1c0b51a44635b62e36fe2b2df59d as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/8edf1c0b51a44635b62e36fe2b2df59d 2023-11-25 12:53:53,736 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/8edf1c0b51a44635b62e36fe2b2df59d, entries=1, sequenceid=21, filesize=4.9 K 2023-11-25 12:53:53,737 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27807dc9fc4b004f8aed835c4201af39 in 433ms, sequenceid=21, compaction requested=true 2023-11-25 12:53:53,737 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:53:53,737 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:53,737 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:53,737 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:53,737 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,737 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:53:53,737 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:53:53,739 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,739 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:53,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:53,740 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,740 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:53,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:53,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:53,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:53,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:53:53,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30533d95[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:53,741 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:53,741 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,743 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,743 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:53,743 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:53:53,743 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,743 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:53,743 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:53,746 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,746 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:53:53,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:53,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:53,746 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:53,746 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:53:53,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:53,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:53,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:53,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:53,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:53,749 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:53:53,749 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:53,749 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:53,749 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,749 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:53,751 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,751 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:53,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:53,751 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:53,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:53,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:53,752 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:53,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:53,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,753 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:53,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,756 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,756 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,756 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,756 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,756 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,756 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,756 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,756 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:53,756 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:53,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-25 12:53:53,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:53,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:53,756 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:53,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:53,757 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:53,757 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:53,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:53,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:53,857 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:53,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:53,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:53,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:53,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,864 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:53,864 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:53,864 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:53:53,864 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:53,865 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,865 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,867 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:53,867 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:53,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:53,867 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:53,867 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:53,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:53,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,868 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,868 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:53:53,868 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:53,868 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:53:53,868 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:53,868 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:53:53,868 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:53,868 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:53,868 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:53,869 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. started... 2023-11-25 12:53:53,869 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27807dc9fc4b004f8aed835c4201af39 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:54,285 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a66a4d1512f44db38139ede18f0dbeb7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231a66a4d1512f44db38139ede18f0dbeb7 2023-11-25 12:53:54,691 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/c0d3db85e22a4c8fbea090a24bd95db7 2023-11-25 12:53:54,696 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/c0d3db85e22a4c8fbea090a24bd95db7 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/c0d3db85e22a4c8fbea090a24bd95db7 2023-11-25 12:53:54,701 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/c0d3db85e22a4c8fbea090a24bd95db7, entries=1, sequenceid=25, filesize=4.9 K 2023-11-25 12:53:54,702 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27807dc9fc4b004f8aed835c4201af39 in 833ms, sequenceid=25, compaction requested=true 2023-11-25 12:53:54,702 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:53:54,702 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:54,702 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:54,702 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:54,702 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,702 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:53:54,702 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:53:54,704 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,704 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:54,705 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,705 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:54,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:54,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:53:54,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b599d66[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:54,707 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:54,707 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,708 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,708 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:54,708 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:53:54,708 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:54,708 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,708 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:54,710 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:53:54,710 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,710 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:54,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:54,710 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:53:54,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:54,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:54,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:54,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:54,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:54,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:54,713 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:53:54,713 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:54,713 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:54,713 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,713 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:54,717 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,717 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:54,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:54,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,717 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:54,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:54,717 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:54,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:54,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:54,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,719 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:54,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,721 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,722 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,722 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:54,722 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:54,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:54,722 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:54,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:54,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:54,722 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:54,722 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,722 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,722 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,722 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,722 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:54,722 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:54,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:54,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:54,822 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:54,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:54,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:54,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:54,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,830 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:54,830 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:54,830 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:53:54,830 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:54,831 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,831 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,832 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,832 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:54,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:54,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:54,833 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:54,833 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:54,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:54,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,834 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,834 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:53:54,834 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:54,834 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:53:54,834 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:54,834 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:53:54,834 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:54,834 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:54,834 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:54,834 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. started... 2023-11-25 12:53:54,834 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27807dc9fc4b004f8aed835c4201af39 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:55,170 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-25 12:53:55,250 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601014f396442fd5d490881b552e9bdef3ead to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601014f396442fd5d490881b552e9bdef3ead 2023-11-25 12:53:55,656 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/7dbc34598c79478ca08cfd66bbf3a743 2023-11-25 12:53:55,661 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/7dbc34598c79478ca08cfd66bbf3a743 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/7dbc34598c79478ca08cfd66bbf3a743 2023-11-25 12:53:55,667 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/7dbc34598c79478ca08cfd66bbf3a743, entries=1, sequenceid=29, filesize=4.9 K 2023-11-25 12:53:55,668 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27807dc9fc4b004f8aed835c4201af39 in 834ms, sequenceid=29, compaction requested=true 2023-11-25 12:53:55,668 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:53:55,668 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:55,668 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:55,668 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:55,668 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,668 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:53:55,668 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:53:55,670 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,670 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:55,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:55,671 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,671 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:55,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:55,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:55,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:55,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:53:55,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@342bf66e[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:55,672 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:55,672 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,674 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,675 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:55,675 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:53:55,675 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:55,675 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,675 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:55,676 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:53:55,676 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,676 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:55,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:55,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:55,676 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:53:55,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:55,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:55,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:55,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:55,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:55,679 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:53:55,679 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:55,679 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:55,679 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,679 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:55,683 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,683 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,683 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:55,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:55,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:55,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:55,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:55,684 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:55,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:55,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,685 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:55,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,688 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,688 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,688 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:55,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:55,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:55,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:55,688 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:55,688 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:55,688 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-25 12:53:55,689 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:55,689 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,689 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:55,689 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:55,689 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:55,689 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:55,789 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:55,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:55,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:55,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:55,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,796 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:55,796 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:55,796 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:53:55,796 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:55,797 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,797 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,798 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:55,798 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:55,799 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,799 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:55,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:55,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,800 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,800 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:53:55,800 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:55,800 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:53:55,800 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:55,800 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:53:55,800 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:55,800 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:55,800 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:55,800 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. started... 2023-11-25 12:53:55,801 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27807dc9fc4b004f8aed835c4201af39 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:56,215 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103265b72bb19b64bceb15c999f725ce24d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103265b72bb19b64bceb15c999f725ce24d 2023-11-25 12:53:56,622 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/308f7b6b3bd64f74bb112e32f0f6f3da 2023-11-25 12:53:56,627 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/308f7b6b3bd64f74bb112e32f0f6f3da as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/308f7b6b3bd64f74bb112e32f0f6f3da 2023-11-25 12:53:56,631 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/308f7b6b3bd64f74bb112e32f0f6f3da, entries=1, sequenceid=33, filesize=4.9 K 2023-11-25 12:53:56,632 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27807dc9fc4b004f8aed835c4201af39 in 831ms, sequenceid=33, compaction requested=true 2023-11-25 12:53:56,633 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:53:56,633 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:56,633 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:56,633 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:56,633 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,633 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:53:56,633 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:53:56,635 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,635 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:56,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:56,635 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,635 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:56,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:56,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:56,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:56,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:53:56,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e512779[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:56,637 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:56,637 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,638 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,638 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:56,638 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:53:56,638 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:56,638 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,638 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:56,641 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,641 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:53:56,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:56,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:56,641 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:56,641 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:53:56,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:56,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:56,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:56,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:56,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:56,643 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:53:56,643 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:56,643 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:56,643 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,643 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:56,645 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,645 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:56,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:56,645 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:56,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:56,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:56,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:56,646 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:56,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,647 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:56,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,649 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,650 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,650 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,650 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,650 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,650 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:56,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:56,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:56,650 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,650 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,650 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:56,651 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:56,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:56,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:56,651 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:56,651 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:56,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:56,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:56,751 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:56,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:56,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:56,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:56,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,759 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:56,759 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:56,759 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:53:56,759 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:56,759 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,759 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,761 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,761 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:56,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:56,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:56,761 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:56,761 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:56,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:56,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,762 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,762 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:53:56,762 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:56,762 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:53:56,763 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:56,763 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:53:56,763 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:56,763 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:56,763 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:56,763 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. started... 2023-11-25 12:53:56,763 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27807dc9fc4b004f8aed835c4201af39 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:57,177 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509072095e5dea88c4b9bb8f4302cb6234526 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509072095e5dea88c4b9bb8f4302cb6234526 2023-11-25 12:53:57,583 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/60385ca52a6f4dedbcc1194254da58f5 2023-11-25 12:53:57,589 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/60385ca52a6f4dedbcc1194254da58f5 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/60385ca52a6f4dedbcc1194254da58f5 2023-11-25 12:53:57,594 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/60385ca52a6f4dedbcc1194254da58f5, entries=1, sequenceid=37, filesize=4.9 K 2023-11-25 12:53:57,595 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27807dc9fc4b004f8aed835c4201af39 in 832ms, sequenceid=37, compaction requested=true 2023-11-25 12:53:57,595 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:53:57,595 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:57,595 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:57,595 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:57,595 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,595 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:53:57,595 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:53:57,598 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,598 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:57,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:57,598 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,598 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:57,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:57,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:57,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:57,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:53:57,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@674714b3[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:57,600 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:57,600 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,601 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,602 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:57,602 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:53:57,602 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,602 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:57,602 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:57,603 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,603 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:53:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:57,603 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:57,603 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:53:57,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:57,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:57,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:57,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:57,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:57,606 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:53:57,606 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:57,606 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:57,606 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,606 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:57,608 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,608 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:57,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:57,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,608 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:57,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:57,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:57,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:57,609 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:57,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,610 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:57,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,614 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,614 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,614 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:57,614 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:57,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:57,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:57,614 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:57,614 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,614 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:57,614 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-25 12:53:57,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:57,614 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:57,615 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:57,614 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,615 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:57,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:57,715 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:57,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:57,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:53:57,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:53:57,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,723 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:57,723 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:57,723 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:53:57,723 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:53:57,724 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,724 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,725 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,725 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:57,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:57,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:57,726 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:57,726 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:53:57,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:53:57,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,727 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,727 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:53:57,727 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:57,728 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:53:57,728 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:53:57,728 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:53:57,728 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:53:57,728 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:53:57,728 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:57,728 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. started... 2023-11-25 12:53:57,728 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27807dc9fc4b004f8aed835c4201af39 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:53:58,146 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120cf046274e76c469f99722a1eb5cab2a9 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120cf046274e76c469f99722a1eb5cab2a9 2023-11-25 12:53:58,553 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/fe730add80954026931ee044d8f5aff9 2023-11-25 12:53:58,559 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/fe730add80954026931ee044d8f5aff9 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/fe730add80954026931ee044d8f5aff9 2023-11-25 12:53:58,563 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/fe730add80954026931ee044d8f5aff9, entries=1, sequenceid=41, filesize=4.9 K 2023-11-25 12:53:58,564 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27807dc9fc4b004f8aed835c4201af39 in 836ms, sequenceid=41, compaction requested=true 2023-11-25 12:53:58,565 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:53:58,565 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:58,565 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:53:58,565 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:53:58,565 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:58,565 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:53:58,565 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:53:58,567 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:58,567 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:58,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:58,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:58,567 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,567 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:53:58,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:58,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:58,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:58,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:58,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:53:58,569 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:53:58,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20320790[Count = 0] remaining members to acquire global barrier 2023-11-25 12:53:58,569 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,575 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,575 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:53:58,575 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:53:58,575 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:53:58,575 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:58,575 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:53:58,576 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:53:58,576 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:58,576 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:58,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:58,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:58,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:58,577 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:53:58,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:58,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:58,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:58,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:58,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:58,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:53:58,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:53:58,579 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:53:58,579 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:53:58,579 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:53:58,579 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,579 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:53:58,582 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,582 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,582 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:53:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:53:58,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:53:58,582 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:58,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:53:58,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:58,585 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:53:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:58,587 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:58,587 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,587 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:53:58,587 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,587 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:53:58,587 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:53:58,587 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:53:58,587 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-25 12:53:58,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:53:58,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:53:58,588 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:53:58,588 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,588 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:53:58,588 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:53:58,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:53:58,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:53:58,688 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:53:58,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:53:58,690 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38201] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-25 12:53:58,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-25 12:53:58,693 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-25 12:53:58,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:53:58,694 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700917438694 2023-11-25 12:53:58,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-25 12:53:58,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-25 12:53:58,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-25 12:53:58,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] zookeeper.ReadOnlyZKClient(139): Connect 0x136a8740 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:53:58,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6db280ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:53:58,704 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:53:59,548 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103db87eab4e1944684a25486a084e131f3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103db87eab4e1944684a25486a084e131f3 2023-11-25 12:53:59,549 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-25 12:53:59,566 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:53:59,567 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:53:59,575 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:53:59,577 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:53:59,587 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de4dd4c302564008b1739e4cf0af7f54 first=Optional[r3] last=Optional[r6] 2023-11-25 12:53:59,587 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de4dd4c302564008b1739e4cf0af7f54}] 2023-11-25 12:53:59,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de4dd4c302564008b1739e4cf0af7f54 for inclusion in 27807dc9fc4b004f8aed835c4201af39/family1 2023-11-25 12:53:59,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-25 12:53:59,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:53:59,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:53:59,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de4dd4c302564008b1739e4cf0af7f54 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f5m6ffbm4qgl1m2244vbpfctbcnp8mhuqjd3ggcfv288mqeglc394pcq6a4vjpvo/family1/de4dd4c302564008b1739e4cf0af7f54 2023-11-25 12:53:59,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f5m6ffbm4qgl1m2244vbpfctbcnp8mhuqjd3ggcfv288mqeglc394pcq6a4vjpvo/family1/de4dd4c302564008b1739e4cf0af7f54 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/d1ddd65d289747c2b05a144d74335cfc_SeqId_44_ 2023-11-25 12:53:59,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f5m6ffbm4qgl1m2244vbpfctbcnp8mhuqjd3ggcfv288mqeglc394pcq6a4vjpvo/family1/de4dd4c302564008b1739e4cf0af7f54 into 27807dc9fc4b004f8aed835c4201af39/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/d1ddd65d289747c2b05a144d74335cfc_SeqId_44_ - updating store file list. 2023-11-25 12:53:59,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/d1ddd65d289747c2b05a144d74335cfc_SeqId_44_ into 27807dc9fc4b004f8aed835c4201af39/family1 2023-11-25 12:53:59,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f5m6ffbm4qgl1m2244vbpfctbcnp8mhuqjd3ggcfv288mqeglc394pcq6a4vjpvo/family1/de4dd4c302564008b1739e4cf0af7f54 into 27807dc9fc4b004f8aed835c4201af39/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/d1ddd65d289747c2b05a144d74335cfc_SeqId_44_) 2023-11-25 12:53:59,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f5m6ffbm4qgl1m2244vbpfctbcnp8mhuqjd3ggcfv288mqeglc394pcq6a4vjpvo/family1/de4dd4c302564008b1739e4cf0af7f54 2023-11-25 12:53:59,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-25 12:53:59,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-25 12:53:59,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(1912): 27807dc9fc4b004f8aed835c4201af39/family1 is initiating minor compaction 2023-11-25 12:53:59,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@221d045a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:53:59,609 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 27807dc9fc4b004f8aed835c4201af39/family1 in testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:53:59,609 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/169d36293def42e1bfcc7cedfa365e92, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/da968bf0685348bb989a2c105113ef34, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/d25f2dc7afed4e35aee08239da298c61, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/8edf1c0b51a44635b62e36fe2b2df59d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/c0d3db85e22a4c8fbea090a24bd95db7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/7dbc34598c79478ca08cfd66bbf3a743, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/308f7b6b3bd64f74bb112e32f0f6f3da, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/60385ca52a6f4dedbcc1194254da58f5, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/fe730add80954026931ee044d8f5aff9, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/d1ddd65d289747c2b05a144d74335cfc_SeqId_44_] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp, totalSize=50.0 K 2023-11-25 12:53:59,609 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 169d36293def42e1bfcc7cedfa365e92, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-25 12:53:59,609 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting da968bf0685348bb989a2c105113ef34, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-25 12:53:59,609 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting d25f2dc7afed4e35aee08239da298c61, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-25 12:53:59,609 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 8edf1c0b51a44635b62e36fe2b2df59d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-25 12:53:59,609 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting c0d3db85e22a4c8fbea090a24bd95db7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-25 12:53:59,609 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 7dbc34598c79478ca08cfd66bbf3a743, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-25 12:53:59,609 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 308f7b6b3bd64f74bb112e32f0f6f3da, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-25 12:53:59,609 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 60385ca52a6f4dedbcc1194254da58f5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-25 12:53:59,609 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting fe730add80954026931ee044d8f5aff9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-25 12:53:59,610 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting d1ddd65d289747c2b05a144d74335cfc_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-25 12:53:59,611 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-25 12:53:59,612 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:53:59,615 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228b0ee16ea91984d9da9779485656d06e7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228b0ee16ea91984d9da9779485656d06e7 2023-11-25 12:53:59,617 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231a66a4d1512f44db38139ede18f0dbeb7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231a66a4d1512f44db38139ede18f0dbeb7 2023-11-25 12:53:59,618 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601014f396442fd5d490881b552e9bdef3ead to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601014f396442fd5d490881b552e9bdef3ead 2023-11-25 12:53:59,620 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103265b72bb19b64bceb15c999f725ce24d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103265b72bb19b64bceb15c999f725ce24d 2023-11-25 12:53:59,620 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-25 12:53:59,620 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-25 12:53:59,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:53:59,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:53:59,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:53:59,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:53:59,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:53:59,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:53:59,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:53:59,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:53:59,641 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 27807dc9fc4b004f8aed835c4201af39#family1#compaction#33 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:53:59,657 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052055c3a4231a42708175b39415034980 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512052055c3a4231a42708175b39415034980 2023-11-25 12:53:59,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-25 12:53:59,683 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8e3e528e446b4195a3619d654f2ed1f0 first=Optional[r1] last=Optional[r2] 2023-11-25 12:53:59,684 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8e3e528e446b4195a3619d654f2ed1f0}] 2023-11-25 12:53:59,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8e3e528e446b4195a3619d654f2ed1f0 for inclusion in 27807dc9fc4b004f8aed835c4201af39/family1 2023-11-25 12:53:59,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-25 12:53:59,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:53:59,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:53:59,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8e3e528e446b4195a3619d654f2ed1f0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__c19goidjgtilk0jd2h7ppo6c09v9ag9njp7fsas7l8s6e5u7jkahftkjlt4c83mm/family1/8e3e528e446b4195a3619d654f2ed1f0 2023-11-25 12:53:59,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__c19goidjgtilk0jd2h7ppo6c09v9ag9njp7fsas7l8s6e5u7jkahftkjlt4c83mm/family1/8e3e528e446b4195a3619d654f2ed1f0 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/758fcb43ade0452a9f1dcbc56e5d3548_SeqId_46_ 2023-11-25 12:53:59,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__c19goidjgtilk0jd2h7ppo6c09v9ag9njp7fsas7l8s6e5u7jkahftkjlt4c83mm/family1/8e3e528e446b4195a3619d654f2ed1f0 into 27807dc9fc4b004f8aed835c4201af39/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/758fcb43ade0452a9f1dcbc56e5d3548_SeqId_46_ - updating store file list. 2023-11-25 12:53:59,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/758fcb43ade0452a9f1dcbc56e5d3548_SeqId_46_ into 27807dc9fc4b004f8aed835c4201af39/family1 2023-11-25 12:53:59,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__c19goidjgtilk0jd2h7ppo6c09v9ag9njp7fsas7l8s6e5u7jkahftkjlt4c83mm/family1/8e3e528e446b4195a3619d654f2ed1f0 into 27807dc9fc4b004f8aed835c4201af39/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/758fcb43ade0452a9f1dcbc56e5d3548_SeqId_46_) 2023-11-25 12:53:59,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__c19goidjgtilk0jd2h7ppo6c09v9ag9njp7fsas7l8s6e5u7jkahftkjlt4c83mm/family1/8e3e528e446b4195a3619d654f2ed1f0 2023-11-25 12:53:59,701 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-25 12:53:59,702 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:53:59,704 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201ddeb400c93b045d294f268fe94d6340c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201ddeb400c93b045d294f268fe94d6340c 2023-11-25 12:53:59,706 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205e9933169e1e64a1392f84a6f96e748ad to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205e9933169e1e64a1392f84a6f96e748ad 2023-11-25 12:53:59,706 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-25 12:53:59,706 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-25 12:53:59,706 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:53:59,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-25 12:53:59,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:53:59,707 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-25 12:53:59,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.0160 sec 2023-11-25 12:53:59,837 INFO [Listener at localhost/45289] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=265 (was 266), OpenFileDescriptor=665 (was 661) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 278), ProcessCount=170 (was 170), AvailableMemoryMB=8210 (was 8301) 2023-11-25 12:53:59,848 INFO [Listener at localhost/45289] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=265, OpenFileDescriptor=665, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=170, AvailableMemoryMB=8209 2023-11-25 12:53:59,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-25 12:53:59,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-25 12:53:59,853 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-25 12:53:59,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-25 12:53:59,854 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-25 12:53:59,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-25 12:53:59,856 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/a5af6d2effa8ff8710911206706bc4ff 2023-11-25 12:53:59,856 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c57e11eaeca2312f287d1e59e1894d94 2023-11-25 12:53:59,856 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732 2023-11-25 12:53:59,857 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c57e11eaeca2312f287d1e59e1894d94 empty. 2023-11-25 12:53:59,857 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732 empty. 2023-11-25 12:53:59,857 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/a5af6d2effa8ff8710911206706bc4ff empty. 2023-11-25 12:53:59,858 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c57e11eaeca2312f287d1e59e1894d94 2023-11-25 12:53:59,858 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/a5af6d2effa8ff8710911206706bc4ff 2023-11-25 12:53:59,858 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732 2023-11-25 12:53:59,858 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-25 12:53:59,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-25 12:54:00,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-25 12:54:00,270 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-25 12:54:00,271 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => a5af6d2effa8ff8710911206706bc4ff, NAME => 'testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:54:00,272 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => c57e11eaeca2312f287d1e59e1894d94, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:54:00,272 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => cbe8aab5265ba45057cccb680074a732, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:54:00,284 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:00,284 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing a5af6d2effa8ff8710911206706bc4ff, disabling compactions & flushes 2023-11-25 12:54:00,284 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:54:00,284 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:54:00,284 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. after waiting 0 ms 2023-11-25 12:54:00,284 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:54:00,284 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:54:00,284 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for a5af6d2effa8ff8710911206706bc4ff: 2023-11-25 12:54:00,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-25 12:54:00,460 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/.tmp/family1/256a69aa634d49e28cac58ff5c5c1753 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/256a69aa634d49e28cac58ff5c5c1753 2023-11-25 12:54:00,466 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 27807dc9fc4b004f8aed835c4201af39/family1 of 27807dc9fc4b004f8aed835c4201af39 into 256a69aa634d49e28cac58ff5c5c1753(size=6.6 K), total size for store is 176.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:54:00,466 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:54:00,467 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700916839608; duration=0sec 2023-11-25 12:54:00,467 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:00,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/169d36293def42e1bfcc7cedfa365e92, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/da968bf0685348bb989a2c105113ef34, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/d25f2dc7afed4e35aee08239da298c61, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/8edf1c0b51a44635b62e36fe2b2df59d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/c0d3db85e22a4c8fbea090a24bd95db7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/7dbc34598c79478ca08cfd66bbf3a743, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/308f7b6b3bd64f74bb112e32f0f6f3da, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/60385ca52a6f4dedbcc1194254da58f5, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/fe730add80954026931ee044d8f5aff9, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/d1ddd65d289747c2b05a144d74335cfc_SeqId_44_] to archive 2023-11-25 12:54:00,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:00,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/169d36293def42e1bfcc7cedfa365e92 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/169d36293def42e1bfcc7cedfa365e92 2023-11-25 12:54:00,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/da968bf0685348bb989a2c105113ef34 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/da968bf0685348bb989a2c105113ef34 2023-11-25 12:54:00,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/d25f2dc7afed4e35aee08239da298c61 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/d25f2dc7afed4e35aee08239da298c61 2023-11-25 12:54:00,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/8edf1c0b51a44635b62e36fe2b2df59d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/8edf1c0b51a44635b62e36fe2b2df59d 2023-11-25 12:54:00,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/c0d3db85e22a4c8fbea090a24bd95db7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/c0d3db85e22a4c8fbea090a24bd95db7 2023-11-25 12:54:00,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/7dbc34598c79478ca08cfd66bbf3a743 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/7dbc34598c79478ca08cfd66bbf3a743 2023-11-25 12:54:00,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/308f7b6b3bd64f74bb112e32f0f6f3da to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/308f7b6b3bd64f74bb112e32f0f6f3da 2023-11-25 12:54:00,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/60385ca52a6f4dedbcc1194254da58f5 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/60385ca52a6f4dedbcc1194254da58f5 2023-11-25 12:54:00,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/fe730add80954026931ee044d8f5aff9 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/fe730add80954026931ee044d8f5aff9 2023-11-25 12:54:00,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/d1ddd65d289747c2b05a144d74335cfc_SeqId_44_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/family1/d1ddd65d289747c2b05a144d74335cfc_SeqId_44_ 2023-11-25 12:54:00,685 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:00,685 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing c57e11eaeca2312f287d1e59e1894d94, disabling compactions & flushes 2023-11-25 12:54:00,685 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:54:00,685 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:54:00,685 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. after waiting 0 ms 2023-11-25 12:54:00,685 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:54:00,685 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:54:00,685 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for c57e11eaeca2312f287d1e59e1894d94: 2023-11-25 12:54:00,685 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:00,685 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing cbe8aab5265ba45057cccb680074a732, disabling compactions & flushes 2023-11-25 12:54:00,685 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:54:00,686 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:54:00,686 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. after waiting 0 ms 2023-11-25 12:54:00,686 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:54:00,686 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:54:00,686 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for cbe8aab5265ba45057cccb680074a732: 2023-11-25 12:54:00,688 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-25 12:54:00,689 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700916840689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916840689"}]},"ts":"1700916840689"} 2023-11-25 12:54:00,690 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700916840689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916840689"}]},"ts":"1700916840689"} 2023-11-25 12:54:00,690 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700916840689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916840689"}]},"ts":"1700916840689"} 2023-11-25 12:54:00,693 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-25 12:54:00,693 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-25 12:54:00,694 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916840694"}]},"ts":"1700916840694"} 2023-11-25 12:54:00,695 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-25 12:54:00,699 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=a5af6d2effa8ff8710911206706bc4ff, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c57e11eaeca2312f287d1e59e1894d94, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cbe8aab5265ba45057cccb680074a732, ASSIGN}] 2023-11-25 12:54:00,701 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=a5af6d2effa8ff8710911206706bc4ff, ASSIGN 2023-11-25 12:54:00,701 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c57e11eaeca2312f287d1e59e1894d94, ASSIGN 2023-11-25 12:54:00,701 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cbe8aab5265ba45057cccb680074a732, ASSIGN 2023-11-25 12:54:00,701 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c57e11eaeca2312f287d1e59e1894d94, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:54:00,702 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cbe8aab5265ba45057cccb680074a732, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:54:00,702 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=a5af6d2effa8ff8710911206706bc4ff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:54:00,853 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c57e11eaeca2312f287d1e59e1894d94, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:00,853 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=cbe8aab5265ba45057cccb680074a732, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:00,853 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=a5af6d2effa8ff8710911206706bc4ff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:00,853 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700916840853"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916840853"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916840853"}]},"ts":"1700916840853"} 2023-11-25 12:54:00,853 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700916840853"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916840853"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916840853"}]},"ts":"1700916840853"} 2023-11-25 12:54:00,853 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700916840853"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916840853"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916840853"}]},"ts":"1700916840853"} 2023-11-25 12:54:00,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure c57e11eaeca2312f287d1e59e1894d94, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:00,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure cbe8aab5265ba45057cccb680074a732, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:00,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure a5af6d2effa8ff8710911206706bc4ff, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:00,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-25 12:54:01,007 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:01,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:54:01,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cbe8aab5265ba45057cccb680074a732, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732.', STARTKEY => '2', ENDKEY => ''} 2023-11-25 12:54:01,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles cbe8aab5265ba45057cccb680074a732 2023-11-25 12:54:01,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:01,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cbe8aab5265ba45057cccb680074a732 2023-11-25 12:54:01,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cbe8aab5265ba45057cccb680074a732 2023-11-25 12:54:01,012 INFO [StoreOpener-cbe8aab5265ba45057cccb680074a732-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cbe8aab5265ba45057cccb680074a732 2023-11-25 12:54:01,014 DEBUG [StoreOpener-cbe8aab5265ba45057cccb680074a732-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1 2023-11-25 12:54:01,014 DEBUG [StoreOpener-cbe8aab5265ba45057cccb680074a732-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1 2023-11-25 12:54:01,014 INFO [StoreOpener-cbe8aab5265ba45057cccb680074a732-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cbe8aab5265ba45057cccb680074a732 columnFamilyName family1 2023-11-25 12:54:01,016 INFO [StoreOpener-cbe8aab5265ba45057cccb680074a732-1] regionserver.HStore(310): Store=cbe8aab5265ba45057cccb680074a732/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:01,017 INFO [StoreOpener-cbe8aab5265ba45057cccb680074a732-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cbe8aab5265ba45057cccb680074a732 2023-11-25 12:54:01,018 DEBUG [StoreOpener-cbe8aab5265ba45057cccb680074a732-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family2 2023-11-25 12:54:01,018 DEBUG [StoreOpener-cbe8aab5265ba45057cccb680074a732-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family2 2023-11-25 12:54:01,019 INFO [StoreOpener-cbe8aab5265ba45057cccb680074a732-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cbe8aab5265ba45057cccb680074a732 columnFamilyName family2 2023-11-25 12:54:01,020 INFO [StoreOpener-cbe8aab5265ba45057cccb680074a732-1] regionserver.HStore(310): Store=cbe8aab5265ba45057cccb680074a732/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:01,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732 2023-11-25 12:54:01,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732 2023-11-25 12:54:01,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-25 12:54:01,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cbe8aab5265ba45057cccb680074a732 2023-11-25 12:54:01,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:54:01,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cbe8aab5265ba45057cccb680074a732; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74243314, jitterRate=0.10631158947944641}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-25 12:54:01,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cbe8aab5265ba45057cccb680074a732: 2023-11-25 12:54:01,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732., pid=32, masterSystemTime=1700916841007 2023-11-25 12:54:01,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:54:01,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:54:01,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:54:01,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a5af6d2effa8ff8710911206706bc4ff, NAME => 'testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff.', STARTKEY => '', ENDKEY => '1'} 2023-11-25 12:54:01,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles a5af6d2effa8ff8710911206706bc4ff 2023-11-25 12:54:01,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:01,031 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=cbe8aab5265ba45057cccb680074a732, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:01,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a5af6d2effa8ff8710911206706bc4ff 2023-11-25 12:54:01,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a5af6d2effa8ff8710911206706bc4ff 2023-11-25 12:54:01,031 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700916841031"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916841031"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916841031"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916841031"}]},"ts":"1700916841031"} 2023-11-25 12:54:01,033 INFO [StoreOpener-a5af6d2effa8ff8710911206706bc4ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a5af6d2effa8ff8710911206706bc4ff 2023-11-25 12:54:01,034 DEBUG [StoreOpener-a5af6d2effa8ff8710911206706bc4ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/a5af6d2effa8ff8710911206706bc4ff/family1 2023-11-25 12:54:01,034 DEBUG [StoreOpener-a5af6d2effa8ff8710911206706bc4ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/a5af6d2effa8ff8710911206706bc4ff/family1 2023-11-25 12:54:01,035 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=32, resume processing ppid=30 2023-11-25 12:54:01,035 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure cbe8aab5265ba45057cccb680074a732, server=jenkins-hbase4.apache.org,37051,1700916801082 in 177 msec 2023-11-25 12:54:01,035 INFO [StoreOpener-a5af6d2effa8ff8710911206706bc4ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5af6d2effa8ff8710911206706bc4ff columnFamilyName family1 2023-11-25 12:54:01,036 INFO [StoreOpener-a5af6d2effa8ff8710911206706bc4ff-1] regionserver.HStore(310): Store=a5af6d2effa8ff8710911206706bc4ff/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:01,036 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cbe8aab5265ba45057cccb680074a732, ASSIGN in 337 msec 2023-11-25 12:54:01,037 INFO [StoreOpener-a5af6d2effa8ff8710911206706bc4ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a5af6d2effa8ff8710911206706bc4ff 2023-11-25 12:54:01,038 DEBUG [StoreOpener-a5af6d2effa8ff8710911206706bc4ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/a5af6d2effa8ff8710911206706bc4ff/family2 2023-11-25 12:54:01,038 DEBUG [StoreOpener-a5af6d2effa8ff8710911206706bc4ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/a5af6d2effa8ff8710911206706bc4ff/family2 2023-11-25 12:54:01,039 INFO [StoreOpener-a5af6d2effa8ff8710911206706bc4ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5af6d2effa8ff8710911206706bc4ff columnFamilyName family2 2023-11-25 12:54:01,041 INFO [StoreOpener-a5af6d2effa8ff8710911206706bc4ff-1] regionserver.HStore(310): Store=a5af6d2effa8ff8710911206706bc4ff/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:01,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/a5af6d2effa8ff8710911206706bc4ff 2023-11-25 12:54:01,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/a5af6d2effa8ff8710911206706bc4ff 2023-11-25 12:54:01,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-25 12:54:01,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a5af6d2effa8ff8710911206706bc4ff 2023-11-25 12:54:01,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/a5af6d2effa8ff8710911206706bc4ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:54:01,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a5af6d2effa8ff8710911206706bc4ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66986250, jitterRate=-0.0018270909786224365}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-25 12:54:01,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a5af6d2effa8ff8710911206706bc4ff: 2023-11-25 12:54:01,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff., pid=33, masterSystemTime=1700916841007 2023-11-25 12:54:01,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:54:01,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:54:01,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:54:01,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c57e11eaeca2312f287d1e59e1894d94, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94.', STARTKEY => '1', ENDKEY => '2'} 2023-11-25 12:54:01,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles c57e11eaeca2312f287d1e59e1894d94 2023-11-25 12:54:01,051 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=a5af6d2effa8ff8710911206706bc4ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:01,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:01,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c57e11eaeca2312f287d1e59e1894d94 2023-11-25 12:54:01,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c57e11eaeca2312f287d1e59e1894d94 2023-11-25 12:54:01,051 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700916841051"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916841051"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916841051"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916841051"}]},"ts":"1700916841051"} 2023-11-25 12:54:01,052 INFO [StoreOpener-c57e11eaeca2312f287d1e59e1894d94-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c57e11eaeca2312f287d1e59e1894d94 2023-11-25 12:54:01,054 DEBUG [StoreOpener-c57e11eaeca2312f287d1e59e1894d94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/c57e11eaeca2312f287d1e59e1894d94/family1 2023-11-25 12:54:01,054 DEBUG [StoreOpener-c57e11eaeca2312f287d1e59e1894d94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/c57e11eaeca2312f287d1e59e1894d94/family1 2023-11-25 12:54:01,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=33, resume processing ppid=28 2023-11-25 12:54:01,054 INFO [StoreOpener-c57e11eaeca2312f287d1e59e1894d94-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c57e11eaeca2312f287d1e59e1894d94 columnFamilyName family1 2023-11-25 12:54:01,055 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure a5af6d2effa8ff8710911206706bc4ff, server=jenkins-hbase4.apache.org,37051,1700916801082 in 195 msec 2023-11-25 12:54:01,055 INFO [StoreOpener-c57e11eaeca2312f287d1e59e1894d94-1] regionserver.HStore(310): Store=c57e11eaeca2312f287d1e59e1894d94/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:01,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=a5af6d2effa8ff8710911206706bc4ff, ASSIGN in 356 msec 2023-11-25 12:54:01,056 INFO [StoreOpener-c57e11eaeca2312f287d1e59e1894d94-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c57e11eaeca2312f287d1e59e1894d94 2023-11-25 12:54:01,057 DEBUG [StoreOpener-c57e11eaeca2312f287d1e59e1894d94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/c57e11eaeca2312f287d1e59e1894d94/family2 2023-11-25 12:54:01,057 DEBUG [StoreOpener-c57e11eaeca2312f287d1e59e1894d94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/c57e11eaeca2312f287d1e59e1894d94/family2 2023-11-25 12:54:01,057 INFO [StoreOpener-c57e11eaeca2312f287d1e59e1894d94-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c57e11eaeca2312f287d1e59e1894d94 columnFamilyName family2 2023-11-25 12:54:01,058 INFO [StoreOpener-c57e11eaeca2312f287d1e59e1894d94-1] regionserver.HStore(310): Store=c57e11eaeca2312f287d1e59e1894d94/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:01,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/c57e11eaeca2312f287d1e59e1894d94 2023-11-25 12:54:01,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/c57e11eaeca2312f287d1e59e1894d94 2023-11-25 12:54:01,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-25 12:54:01,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c57e11eaeca2312f287d1e59e1894d94 2023-11-25 12:54:01,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/c57e11eaeca2312f287d1e59e1894d94/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:54:01,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c57e11eaeca2312f287d1e59e1894d94; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65886849, jitterRate=-0.018209442496299744}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-25 12:54:01,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c57e11eaeca2312f287d1e59e1894d94: 2023-11-25 12:54:01,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94., pid=31, masterSystemTime=1700916841007 2023-11-25 12:54:01,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:54:01,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:54:01,067 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c57e11eaeca2312f287d1e59e1894d94, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:01,067 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700916841067"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916841067"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916841067"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916841067"}]},"ts":"1700916841067"} 2023-11-25 12:54:01,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=31, resume processing ppid=29 2023-11-25 12:54:01,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure c57e11eaeca2312f287d1e59e1894d94, server=jenkins-hbase4.apache.org,37051,1700916801082 in 214 msec 2023-11-25 12:54:01,072 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=29, resume processing ppid=27 2023-11-25 12:54:01,072 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c57e11eaeca2312f287d1e59e1894d94, ASSIGN in 372 msec 2023-11-25 12:54:01,073 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-25 12:54:01,073 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916841073"}]},"ts":"1700916841073"} 2023-11-25 12:54:01,074 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-25 12:54:01,076 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-25 12:54:01,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2250 sec 2023-11-25 12:54:01,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-25 12:54:01,961 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-25 12:54:01,987 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:54:01,987 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f7e3ffe to 127.0.0.1:63200 2023-11-25 12:54:01,987 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:54:01,988 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:54:01,990 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x136a8740 to 127.0.0.1:63200 2023-11-25 12:54:01,990 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:54:01,990 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:54:01,990 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x773e7e14 to 127.0.0.1:63200 2023-11-25 12:54:01,990 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:54:01,991 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:54:01,991 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f955da9 to 127.0.0.1:63200 2023-11-25 12:54:01,991 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:54:01,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:01,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:01,996 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-25 12:54:01,996 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:01,996 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-25 12:54:01,996 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-25 12:54:01,997 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:01,997 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:01,998 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:01,998 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:01,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:01,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:01,998 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:01,998 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:01,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:01,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:01,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:01,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:01,999 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:01,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:01,999 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-25 12:54:02,000 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:02,000 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-25 12:54:02,000 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:54:02,000 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. started... 2023-11-25 12:54:02,000 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:54:02,000 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:54:02,000 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cbe8aab5265ba45057cccb680074a732 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-25 12:54:02,000 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:54:02,001 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. started... 2023-11-25 12:54:02,000 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. started... 2023-11-25 12:54:02,000 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:02,002 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c57e11eaeca2312f287d1e59e1894d94: 2023-11-25 12:54:02,002 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a5af6d2effa8ff8710911206706bc4ff: 2023-11-25 12:54:02,002 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:54:02,002 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:54:02,002 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:54:02,002 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:54:02,420 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311258b4215f1ec3e43008b82cdd916ec7ae8 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311258b4215f1ec3e43008b82cdd916ec7ae8 2023-11-25 12:54:02,827 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/.tmp/family1/7000fb6fc71e4529b33fb3143c56ebd1 2023-11-25 12:54:02,832 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/.tmp/family1/7000fb6fc71e4529b33fb3143c56ebd1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/7000fb6fc71e4529b33fb3143c56ebd1 2023-11-25 12:54:02,837 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/7000fb6fc71e4529b33fb3143c56ebd1, entries=1, sequenceid=5, filesize=4.9 K 2023-11-25 12:54:02,838 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for cbe8aab5265ba45057cccb680074a732 in 838ms, sequenceid=5, compaction requested=false 2023-11-25 12:54:02,838 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-25 12:54:02,839 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cbe8aab5265ba45057cccb680074a732: 2023-11-25 12:54:02,839 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:54:02,839 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:54:02,839 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:54:02,839 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,839 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-25 12:54:02,839 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-25 12:54:02,842 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,842 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:02,842 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,842 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:02,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-25 12:54:02,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b410d7e[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:02,844 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-25 12:54:02,844 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,846 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,846 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-25 12:54:02,846 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-25 12:54:02,846 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:02,846 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,846 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:02,848 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-25 12:54:02,848 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,848 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:02,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:02,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:02,848 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-25 12:54:02,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:02,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:02,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:02,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:02,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-25 12:54:02,851 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-25 12:54:02,851 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:02,851 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:02,851 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,851 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:02,853 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,853 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:02,853 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:02,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:02,854 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,855 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,859 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,859 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:02,859 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,859 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:02,859 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-25 12:54:02,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:02,859 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:02,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:02,859 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,860 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-25 12:54:02,860 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:02,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:02,860 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,860 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:02,860 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,960 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:02,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:02,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:02,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:02,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,967 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-25 12:54:02,967 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:02,967 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-25 12:54:02,967 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-25 12:54:02,968 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,968 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,970 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:02,970 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:02,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:02,970 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:02,970 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:02,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:02,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,971 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,971 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-25 12:54:02,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:02,971 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-25 12:54:02,971 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:02,971 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-25 12:54:02,972 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:54:02,972 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:54:02,972 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:02,972 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. started... 2023-11-25 12:54:02,972 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:54:02,972 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. started... 2023-11-25 12:54:02,972 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cbe8aab5265ba45057cccb680074a732 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-25 12:54:02,972 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:54:02,972 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a5af6d2effa8ff8710911206706bc4ff: 2023-11-25 12:54:02,972 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:54:02,972 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. started... 2023-11-25 12:54:02,972 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:54:02,972 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c57e11eaeca2312f287d1e59e1894d94: 2023-11-25 12:54:02,972 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:54:02,972 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:54:03,387 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311257213d40a05d042bcacae076ebb07285b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311257213d40a05d042bcacae076ebb07285b 2023-11-25 12:54:03,793 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/.tmp/family1/ac3f2a49cbfe42279551dfa77a5494ed 2023-11-25 12:54:03,799 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/.tmp/family1/ac3f2a49cbfe42279551dfa77a5494ed as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/ac3f2a49cbfe42279551dfa77a5494ed 2023-11-25 12:54:03,804 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/ac3f2a49cbfe42279551dfa77a5494ed, entries=2, sequenceid=9, filesize=5.0 K 2023-11-25 12:54:03,805 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for cbe8aab5265ba45057cccb680074a732 in 833ms, sequenceid=9, compaction requested=false 2023-11-25 12:54:03,805 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cbe8aab5265ba45057cccb680074a732: 2023-11-25 12:54:03,805 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:54:03,805 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:54:03,805 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:54:03,806 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:03,806 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-25 12:54:03,806 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-25 12:54:03,808 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:03,808 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:03,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:03,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:03,808 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,808 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:03,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:03,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:03,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-25 12:54:03,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c6c8180[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:03,810 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-25 12:54:03,810 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,811 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,812 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-25 12:54:03,812 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-25 12:54:03,812 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:03,812 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:03,812 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:03,819 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-25 12:54:03,819 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:03,819 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:03,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:03,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:03,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:03,819 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-25 12:54:03,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:03,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:03,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:03,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:03,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:03,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:03,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-25 12:54:03,822 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-25 12:54:03,822 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:03,822 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:03,822 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,822 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:03,827 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,827 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:03,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:03,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,827 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:03,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:03,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:03,828 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:03,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:03,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:03,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,829 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:03,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:03,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:03,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:03,831 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:03,832 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,832 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,832 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:03,832 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:03,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:03,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-25 12:54:03,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-25 12:54:03,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:03,832 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:03,832 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,832 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:03,832 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,832 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,832 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:03,832 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:03,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:03,932 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:03,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:03,941 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38201] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-25 12:54:03,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-25 12:54:03,943 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-25 12:54:03,944 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700917443944 2023-11-25 12:54:03,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:03,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-25 12:54:03,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-25 12:54:03,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-25 12:54:03,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] zookeeper.ReadOnlyZKClient(139): Connect 0x10049ec5 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:54:03,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6948c1d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:54:03,952 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231125 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-25 12:54:04,781 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311253f488b67a8cc462ea3f4ad9e47a9b0bb to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311253f488b67a8cc462ea3f4ad9e47a9b0bb 2023-11-25 12:54:04,782 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231125 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-25 12:54:04,795 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:54:04,796 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:54:04,803 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:54:04,805 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:54:04,814 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231125/family1/9865c24dbacb44e4b812ec3b2fe6f6b7 first=Optional[k0] last=Optional[k1] 2023-11-25 12:54:04,814 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231125/family1/9865c24dbacb44e4b812ec3b2fe6f6b7}] 2023-11-25 12:54:04,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231125/family1/9865c24dbacb44e4b812ec3b2fe6f6b7 for inclusion in cbe8aab5265ba45057cccb680074a732/family1 2023-11-25 12:54:04,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-25 12:54:04,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-25 12:54:04,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for cbe8aab5265ba45057cccb680074a732: 2023-11-25 12:54:04,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231125/family1/9865c24dbacb44e4b812ec3b2fe6f6b7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testScannerOnBulkLoadRefHFiles__umkbnfcfh7bdf4o92eud86plmvuio7kf32os6va30bodd62foln5c3089lijqr37/family1/9865c24dbacb44e4b812ec3b2fe6f6b7 2023-11-25 12:54:04,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testScannerOnBulkLoadRefHFiles__umkbnfcfh7bdf4o92eud86plmvuio7kf32os6va30bodd62foln5c3089lijqr37/family1/9865c24dbacb44e4b812ec3b2fe6f6b7 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/0e21a8ab4c954333b473b22d1785ba46_SeqId_12_ 2023-11-25 12:54:04,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testScannerOnBulkLoadRefHFiles__umkbnfcfh7bdf4o92eud86plmvuio7kf32os6va30bodd62foln5c3089lijqr37/family1/9865c24dbacb44e4b812ec3b2fe6f6b7 into cbe8aab5265ba45057cccb680074a732/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/0e21a8ab4c954333b473b22d1785ba46_SeqId_12_ - updating store file list. 2023-11-25 12:54:04,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/0e21a8ab4c954333b473b22d1785ba46_SeqId_12_ into cbe8aab5265ba45057cccb680074a732/family1 2023-11-25 12:54:04,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testScannerOnBulkLoadRefHFiles__umkbnfcfh7bdf4o92eud86plmvuio7kf32os6va30bodd62foln5c3089lijqr37/family1/9865c24dbacb44e4b812ec3b2fe6f6b7 into cbe8aab5265ba45057cccb680074a732/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/0e21a8ab4c954333b473b22d1785ba46_SeqId_12_) 2023-11-25 12:54:04,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testScannerOnBulkLoadRefHFiles__umkbnfcfh7bdf4o92eud86plmvuio7kf32os6va30bodd62foln5c3089lijqr37/family1/9865c24dbacb44e4b812ec3b2fe6f6b7 2023-11-25 12:54:04,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-25 12:54:04,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-25 12:54:04,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(1912): cbe8aab5265ba45057cccb680074a732/family1 is initiating minor compaction (all files) 2023-11-25 12:54:04,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@8c8e79d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:04,833 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cbe8aab5265ba45057cccb680074a732/family1 in testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:54:04,833 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/7000fb6fc71e4529b33fb3143c56ebd1, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/ac3f2a49cbfe42279551dfa77a5494ed, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/0e21a8ab4c954333b473b22d1785ba46_SeqId_12_] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/.tmp, totalSize=15.1 K 2023-11-25 12:54:04,834 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 7000fb6fc71e4529b33fb3143c56ebd1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916841961 2023-11-25 12:54:04,834 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting ac3f2a49cbfe42279551dfa77a5494ed, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916841961 2023-11-25 12:54:04,835 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 0e21a8ab4c954333b473b22d1785ba46_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916841961 2023-11-25 12:54:04,835 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231125 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-25 12:54:04,836 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:04,839 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311257213d40a05d042bcacae076ebb07285b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311257213d40a05d042bcacae076ebb07285b 2023-11-25 12:54:04,842 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311258b4215f1ec3e43008b82cdd916ec7ae8 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311258b4215f1ec3e43008b82cdd916ec7ae8 2023-11-25 12:54:04,842 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-25 12:54:04,842 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231125' 2023-11-25 12:54:04,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231125 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-25 12:54:04,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-25 12:54:04,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:04,844 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-25 12:54:04,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 903 msec 2023-11-25 12:54:04,852 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): cbe8aab5265ba45057cccb680074a732#family1#compaction#36 average throughput is 0.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:54:04,879 INFO [Listener at localhost/45289] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=249 (was 265), OpenFileDescriptor=632 (was 665), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=238 (was 250), ProcessCount=170 (was 170), AvailableMemoryMB=8160 (was 8209) 2023-11-25 12:54:04,892 INFO [Listener at localhost/45289] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=249, OpenFileDescriptor=632, MaxFileDescriptor=60000, SystemLoadAverage=238, ProcessCount=170, AvailableMemoryMB=8160 2023-11-25 12:54:04,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-25 12:54:04,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:04,897 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-25 12:54:04,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-25 12:54:04,898 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-25 12:54:04,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-25 12:54:04,900 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a 2023-11-25 12:54:04,900 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a empty. 2023-11-25 12:54:04,901 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a 2023-11-25 12:54:04,901 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-25 12:54:05,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-25 12:54:05,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-25 12:54:05,309 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-25 12:54:05,310 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => e610b0aabe2bce69b899dd05ec92035a, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:54:05,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-25 12:54:05,717 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:05,717 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing e610b0aabe2bce69b899dd05ec92035a, disabling compactions & flushes 2023-11-25 12:54:05,717 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:05,717 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:05,717 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. after waiting 0 ms 2023-11-25 12:54:05,717 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:05,717 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:05,717 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:05,720 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-25 12:54:05,721 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700916845721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916845721"}]},"ts":"1700916845721"} 2023-11-25 12:54:05,722 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-25 12:54:05,723 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-25 12:54:05,723 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916845723"}]},"ts":"1700916845723"} 2023-11-25 12:54:05,724 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-25 12:54:05,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e610b0aabe2bce69b899dd05ec92035a, ASSIGN}] 2023-11-25 12:54:05,731 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e610b0aabe2bce69b899dd05ec92035a, ASSIGN 2023-11-25 12:54:05,731 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e610b0aabe2bce69b899dd05ec92035a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:54:05,882 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e610b0aabe2bce69b899dd05ec92035a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:05,882 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700916845882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916845882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916845882"}]},"ts":"1700916845882"} 2023-11-25 12:54:05,884 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure e610b0aabe2bce69b899dd05ec92035a, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:06,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-25 12:54:06,036 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:06,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:06,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e610b0aabe2bce69b899dd05ec92035a, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a.', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:54:06,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy e610b0aabe2bce69b899dd05ec92035a 2023-11-25 12:54:06,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:06,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e610b0aabe2bce69b899dd05ec92035a 2023-11-25 12:54:06,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e610b0aabe2bce69b899dd05ec92035a 2023-11-25 12:54:06,041 INFO [StoreOpener-e610b0aabe2bce69b899dd05ec92035a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e610b0aabe2bce69b899dd05ec92035a 2023-11-25 12:54:06,042 DEBUG [StoreOpener-e610b0aabe2bce69b899dd05ec92035a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1 2023-11-25 12:54:06,042 DEBUG [StoreOpener-e610b0aabe2bce69b899dd05ec92035a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1 2023-11-25 12:54:06,042 INFO [StoreOpener-e610b0aabe2bce69b899dd05ec92035a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e610b0aabe2bce69b899dd05ec92035a columnFamilyName family1 2023-11-25 12:54:06,044 INFO [StoreOpener-e610b0aabe2bce69b899dd05ec92035a-1] regionserver.HStore(310): Store=e610b0aabe2bce69b899dd05ec92035a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:06,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a 2023-11-25 12:54:06,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a 2023-11-25 12:54:06,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e610b0aabe2bce69b899dd05ec92035a 2023-11-25 12:54:06,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:54:06,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e610b0aabe2bce69b899dd05ec92035a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61712184, jitterRate=-0.08041679859161377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-25 12:54:06,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:06,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a., pid=37, masterSystemTime=1700916846036 2023-11-25 12:54:06,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:06,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:06,052 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e610b0aabe2bce69b899dd05ec92035a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:06,053 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700916846052"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916846052"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916846052"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916846052"}]},"ts":"1700916846052"} 2023-11-25 12:54:06,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=37, resume processing ppid=36 2023-11-25 12:54:06,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure e610b0aabe2bce69b899dd05ec92035a, server=jenkins-hbase4.apache.org,37051,1700916801082 in 170 msec 2023-11-25 12:54:06,057 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=36, resume processing ppid=35 2023-11-25 12:54:06,057 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e610b0aabe2bce69b899dd05ec92035a, ASSIGN in 326 msec 2023-11-25 12:54:06,058 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-25 12:54:06,058 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916846058"}]},"ts":"1700916846058"} 2023-11-25 12:54:06,059 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-25 12:54:06,061 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-25 12:54:06,062 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1660 sec 2023-11-25 12:54:06,076 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/.tmp/family1/54d0522b58284da7a2af75dbc9b5eba3 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/54d0522b58284da7a2af75dbc9b5eba3 2023-11-25 12:54:06,081 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cbe8aab5265ba45057cccb680074a732/family1 of cbe8aab5265ba45057cccb680074a732 into 54d0522b58284da7a2af75dbc9b5eba3(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:54:06,081 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cbe8aab5265ba45057cccb680074a732: 2023-11-25 12:54:06,081 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1700916844833; duration=1sec 2023-11-25 12:54:06,082 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:06,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/7000fb6fc71e4529b33fb3143c56ebd1, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/ac3f2a49cbfe42279551dfa77a5494ed, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/0e21a8ab4c954333b473b22d1785ba46_SeqId_12_] to archive 2023-11-25 12:54:06,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:06,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/7000fb6fc71e4529b33fb3143c56ebd1 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/7000fb6fc71e4529b33fb3143c56ebd1 2023-11-25 12:54:06,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/ac3f2a49cbfe42279551dfa77a5494ed to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/ac3f2a49cbfe42279551dfa77a5494ed 2023-11-25 12:54:06,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/0e21a8ab4c954333b473b22d1785ba46_SeqId_12_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/family1/0e21a8ab4c954333b473b22d1785ba46_SeqId_12_ 2023-11-25 12:54:06,538 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-25 12:54:07,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-25 12:54:07,005 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-25 12:54:07,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:07,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,030 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:07,030 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:07,030 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:54:07,030 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:54:07,031 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,031 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,033 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:07,033 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:07,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:07,033 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,033 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:07,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,034 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,034 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,034 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:54:07,034 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:07,034 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:54:07,035 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:07,035 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:07,035 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:07,035 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. started... 2023-11-25 12:54:07,035 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e610b0aabe2bce69b899dd05ec92035a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-25 12:54:07,453 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113005998d9cceb54f3e8e6ccf7794ea4ea4 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113005998d9cceb54f3e8e6ccf7794ea4ea4 2023-11-25 12:54:07,857 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/61ac8e36e8974903ba12425648416557 2023-11-25 12:54:07,863 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/61ac8e36e8974903ba12425648416557 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/61ac8e36e8974903ba12425648416557 2023-11-25 12:54:07,868 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/61ac8e36e8974903ba12425648416557, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-25 12:54:07,869 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e610b0aabe2bce69b899dd05ec92035a in 834ms, sequenceid=5, compaction requested=false 2023-11-25 12:54:07,869 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:07,869 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:07,869 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:54:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:54:07,872 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,872 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:07,873 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,873 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:07,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:54:07,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53d1ee32[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:07,874 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:54:07,874 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,875 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,876 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:54:07,876 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:54:07,876 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:07,876 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,876 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:07,877 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:54:07,877 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:07,877 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,877 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:54:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:07,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:07,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:07,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:07,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:07,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:54:07,880 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:54:07,880 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:07,880 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:07,880 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,880 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:07,882 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,882 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:07,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:07,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,882 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:07,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:07,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:07,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:07,882 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:07,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,884 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,888 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,888 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,888 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,888 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:07,888 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,888 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:07,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:07,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:07,888 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:07,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:07,888 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:07,888 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,888 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,888 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:07,888 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:07,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:07,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:07,988 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:07,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:07,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:07,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:07,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,995 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:07,995 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:07,996 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:54:07,996 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:54:07,996 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,996 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,997 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,997 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:07,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:07,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:07,998 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:07,998 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:07,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:07,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,999 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,999 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:54:07,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:07,999 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:54:07,999 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:07,999 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:54:08,000 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:08,000 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:08,000 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:08,000 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. started... 2023-11-25 12:54:08,000 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e610b0aabe2bce69b899dd05ec92035a 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-25 12:54:08,414 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128017dca3554514c48b68ec12cb2a6ab9a to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128017dca3554514c48b68ec12cb2a6ab9a 2023-11-25 12:54:08,820 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/000ce15dfbf842cc94d72bf414fc9ee8 2023-11-25 12:54:08,826 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/000ce15dfbf842cc94d72bf414fc9ee8 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/000ce15dfbf842cc94d72bf414fc9ee8 2023-11-25 12:54:08,830 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/000ce15dfbf842cc94d72bf414fc9ee8, entries=1, sequenceid=9, filesize=5.0 K 2023-11-25 12:54:08,831 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e610b0aabe2bce69b899dd05ec92035a in 831ms, sequenceid=9, compaction requested=false 2023-11-25 12:54:08,831 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:08,831 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:08,831 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:08,831 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:08,831 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,831 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:54:08,831 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:54:08,833 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,833 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:08,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:08,833 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,833 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:08,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:08,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:08,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:08,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:54:08,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63ef6d5f[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:08,835 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:54:08,835 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,836 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,836 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:54:08,836 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:54:08,836 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:08,837 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,837 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:08,839 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:54:08,839 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,839 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:08,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:08,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:08,839 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:54:08,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:08,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:08,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:08,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:08,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:54:08,842 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:54:08,842 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:08,842 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:08,842 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,842 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:08,844 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,844 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:08,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,844 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:08,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:08,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:08,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:08,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:08,844 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:08,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,846 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:08,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,851 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,851 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:08,851 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:08,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:08,851 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:08,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:08,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:08,851 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:08,851 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-25 12:54:08,851 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:08,852 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:08,852 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:08,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:08,851 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,852 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,852 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,952 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:08,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:08,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:08,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:08,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,959 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:08,959 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:08,959 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:54:08,959 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:54:08,959 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,959 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,961 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:08,961 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:08,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:08,962 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:08,962 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:08,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:08,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,963 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,963 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:54:08,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:08,963 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:54:08,963 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:08,963 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:54:08,963 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:08,963 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:08,963 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. started... 2023-11-25 12:54:08,963 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:08,963 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e610b0aabe2bce69b899dd05ec92035a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:09,378 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011c723ae7e0944e84aed03b0e6db71160 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011c723ae7e0944e84aed03b0e6db71160 2023-11-25 12:54:09,784 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/52897544165844c7a50cf03bca47eb19 2023-11-25 12:54:09,789 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/52897544165844c7a50cf03bca47eb19 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/52897544165844c7a50cf03bca47eb19 2023-11-25 12:54:09,793 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/52897544165844c7a50cf03bca47eb19, entries=1, sequenceid=13, filesize=4.9 K 2023-11-25 12:54:09,794 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e610b0aabe2bce69b899dd05ec92035a in 831ms, sequenceid=13, compaction requested=true 2023-11-25 12:54:09,794 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:09,794 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:09,794 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:09,794 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:09,794 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,794 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:54:09,794 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:54:09,796 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,796 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:09,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:09,797 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,797 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:09,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:09,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:09,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:09,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:54:09,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2086b6a1[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:09,798 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:54:09,798 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,800 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,800 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:54:09,800 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:54:09,800 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:09,800 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,800 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:09,801 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,801 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:54:09,801 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:09,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:09,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:09,801 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:54:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:09,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:09,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:54:09,804 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:54:09,804 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:09,804 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:09,804 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,804 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:09,806 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,806 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:09,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:09,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,806 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:09,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:09,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:09,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:09,807 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:09,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,808 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:09,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,810 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,810 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:09,810 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:09,811 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:09,811 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,811 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:09,811 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:09,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:09,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:09,811 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,811 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,811 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:09,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:09,811 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:09,811 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:09,911 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:09,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:09,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:09,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:09,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,918 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:09,918 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:09,918 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:54:09,918 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:54:09,919 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,919 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,920 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:09,920 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:09,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:09,921 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:09,921 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,922 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,922 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:54:09,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:09,922 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:54:09,922 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:09,922 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:54:09,922 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:09,922 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:09,922 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:09,922 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. started... 2023-11-25 12:54:09,923 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e610b0aabe2bce69b899dd05ec92035a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:09,935 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205df5afc2987ce49a5abd4aca1b76a9f59 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205df5afc2987ce49a5abd4aca1b76a9f59 2023-11-25 12:54:10,342 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/78ca080abeb14feaa4a839068a2b3a5f 2023-11-25 12:54:10,348 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/78ca080abeb14feaa4a839068a2b3a5f as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/78ca080abeb14feaa4a839068a2b3a5f 2023-11-25 12:54:10,352 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/78ca080abeb14feaa4a839068a2b3a5f, entries=1, sequenceid=17, filesize=4.9 K 2023-11-25 12:54:10,353 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e610b0aabe2bce69b899dd05ec92035a in 431ms, sequenceid=17, compaction requested=true 2023-11-25 12:54:10,353 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:10,353 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:10,353 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:10,353 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:10,353 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,353 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:54:10,354 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:54:10,355 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,355 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:10,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:10,356 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:10,356 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:10,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:10,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:10,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:54:10,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@488e53b0[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:10,357 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:54:10,357 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,360 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,360 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:54:10,360 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:54:10,360 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:10,360 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,360 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:10,361 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,361 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:54:10,362 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:10,362 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:54:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:10,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:54:10,364 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:54:10,364 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:10,364 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:10,364 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,364 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:10,366 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,366 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,366 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:10,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:10,367 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,368 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:10,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,370 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,370 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,370 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:10,370 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:10,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:10,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:10,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:10,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-25 12:54:10,370 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:10,370 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,370 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:10,371 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,371 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:10,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:10,371 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,371 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:10,371 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,471 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:10,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:10,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:10,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:10,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,478 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:10,478 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:10,478 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:54:10,478 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:54:10,478 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,478 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,481 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:10,481 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:10,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:10,482 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:10,482 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:10,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:10,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,482 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,483 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:54:10,483 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:10,483 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:54:10,483 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:10,483 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:54:10,483 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:10,483 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:10,483 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:10,483 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. started... 2023-11-25 12:54:10,483 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e610b0aabe2bce69b899dd05ec92035a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:10,898 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122836cd8a0f27674a7891e15e658385676e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122836cd8a0f27674a7891e15e658385676e 2023-11-25 12:54:11,304 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/aaa056aef7e84c8fa0c62424aceeeb3b 2023-11-25 12:54:11,309 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/aaa056aef7e84c8fa0c62424aceeeb3b as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/aaa056aef7e84c8fa0c62424aceeeb3b 2023-11-25 12:54:11,313 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/aaa056aef7e84c8fa0c62424aceeeb3b, entries=1, sequenceid=21, filesize=4.9 K 2023-11-25 12:54:11,314 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e610b0aabe2bce69b899dd05ec92035a in 831ms, sequenceid=21, compaction requested=true 2023-11-25 12:54:11,314 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:11,314 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:11,314 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:11,314 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:11,314 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,314 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:54:11,314 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:54:11,316 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,316 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:11,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:11,317 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,317 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:11,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:11,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:11,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:11,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:54:11,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14f284ed[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:11,318 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:54:11,318 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,319 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,319 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:54:11,319 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:54:11,319 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:11,320 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,320 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:11,321 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:54:11,321 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,321 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:11,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:11,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:11,321 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:54:11,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:11,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:11,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:11,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:54:11,324 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:54:11,324 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:11,324 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:11,324 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,324 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:11,330 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:11,330 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,330 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:11,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:11,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:11,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:11,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:11,331 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:11,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,332 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:11,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,334 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,334 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,334 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,334 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,334 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:11,334 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,334 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:11,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:11,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-25 12:54:11,334 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:11,334 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,334 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:11,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:11,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:11,335 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:11,335 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:11,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:11,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:11,435 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:11,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:11,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:11,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:11,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,442 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:11,442 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:11,442 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:54:11,442 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:54:11,442 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,442 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,444 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,444 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:11,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:11,444 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:11,444 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:11,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,445 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,445 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:54:11,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:11,445 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:54:11,445 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:11,445 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:54:11,445 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:11,445 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:11,446 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:11,446 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. started... 2023-11-25 12:54:11,446 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e610b0aabe2bce69b899dd05ec92035a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:11,541 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-25 12:54:11,858 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ff5ba819284640acab29dea679376df6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231ff5ba819284640acab29dea679376df6 2023-11-25 12:54:12,264 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/a6adb7d186af4efd997f86758aa843e3 2023-11-25 12:54:12,269 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/a6adb7d186af4efd997f86758aa843e3 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/a6adb7d186af4efd997f86758aa843e3 2023-11-25 12:54:12,273 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/a6adb7d186af4efd997f86758aa843e3, entries=1, sequenceid=25, filesize=4.9 K 2023-11-25 12:54:12,274 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e610b0aabe2bce69b899dd05ec92035a in 828ms, sequenceid=25, compaction requested=true 2023-11-25 12:54:12,274 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:12,274 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:12,274 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:12,274 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:12,274 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,274 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:54:12,274 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:54:12,276 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,276 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:12,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:12,276 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,277 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:12,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:12,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:12,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:12,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:54:12,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c6f86b9[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:12,278 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:54:12,278 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,280 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,280 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:54:12,280 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:54:12,280 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:12,280 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,280 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:12,282 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,282 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:54:12,282 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:12,282 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:54:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:12,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:54:12,284 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:54:12,284 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:12,284 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:12,284 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,284 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:12,286 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,286 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,286 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:12,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:12,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:12,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:12,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:12,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:12,287 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:12,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,288 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,290 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,290 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,290 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,290 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:12,291 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:12,291 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:12,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:12,291 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:12,291 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:12,291 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:12,291 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,291 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:12,291 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:12,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:12,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:12,391 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:12,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:12,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:12,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:12,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,398 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:12,398 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:12,398 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:54:12,398 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:54:12,399 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,399 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,401 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:12,401 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:12,401 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:12,401 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:12,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,402 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,402 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:54:12,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:12,402 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:54:12,402 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:12,402 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:54:12,403 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:12,403 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:12,403 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:12,403 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. started... 2023-11-25 12:54:12,403 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e610b0aabe2bce69b899dd05ec92035a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:12,815 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601011b73e4656bea48e4b6993f3ee7ee7b28 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601011b73e4656bea48e4b6993f3ee7ee7b28 2023-11-25 12:54:13,221 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/3d1c4bc89ebf4f679bb8973efa55cb8c 2023-11-25 12:54:13,226 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/3d1c4bc89ebf4f679bb8973efa55cb8c as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/3d1c4bc89ebf4f679bb8973efa55cb8c 2023-11-25 12:54:13,230 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/3d1c4bc89ebf4f679bb8973efa55cb8c, entries=1, sequenceid=29, filesize=4.9 K 2023-11-25 12:54:13,231 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e610b0aabe2bce69b899dd05ec92035a in 828ms, sequenceid=29, compaction requested=true 2023-11-25 12:54:13,231 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:13,231 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:13,231 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:13,231 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:13,231 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,231 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:54:13,231 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:54:13,233 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,233 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:13,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:13,233 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,233 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:13,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:13,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:13,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:13,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:54:13,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19491a2b[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:13,235 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:54:13,235 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,236 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,236 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:54:13,236 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:54:13,236 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:13,236 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,236 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:13,238 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:54:13,238 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,238 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:13,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:13,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:13,238 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:54:13,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:13,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:13,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:13,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:13,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:54:13,240 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:54:13,240 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:13,240 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:13,240 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,240 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:13,243 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,243 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:13,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:13,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,243 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:13,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:13,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:13,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:13,244 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:13,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,245 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:13,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,248 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,248 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,248 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:13,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:13,248 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,248 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:13,248 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:13,248 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:13,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:13,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:13,248 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,248 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,248 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,249 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:13,249 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:13,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:13,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:13,349 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:13,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:13,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:13,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:13,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,356 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:13,356 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:13,356 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:54:13,356 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:54:13,356 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,356 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,358 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:13,358 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:13,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:13,358 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:13,358 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:13,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:13,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,359 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,359 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:54:13,359 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:13,359 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:54:13,359 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:13,359 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:54:13,360 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:13,360 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:13,360 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:13,360 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. started... 2023-11-25 12:54:13,360 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e610b0aabe2bce69b899dd05ec92035a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:13,773 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033ece843d3710417cbaf4a5e1882a9ae2 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601033ece843d3710417cbaf4a5e1882a9ae2 2023-11-25 12:54:14,179 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/9696a3c80dde4dcfb8c349d45a40fffb 2023-11-25 12:54:14,184 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/9696a3c80dde4dcfb8c349d45a40fffb as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/9696a3c80dde4dcfb8c349d45a40fffb 2023-11-25 12:54:14,189 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/9696a3c80dde4dcfb8c349d45a40fffb, entries=1, sequenceid=33, filesize=4.9 K 2023-11-25 12:54:14,190 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e610b0aabe2bce69b899dd05ec92035a in 829ms, sequenceid=33, compaction requested=true 2023-11-25 12:54:14,190 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:14,190 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:14,190 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:14,190 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:14,190 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,190 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:54:14,190 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:54:14,192 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,192 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:14,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:14,192 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,192 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:14,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:14,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:14,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:14,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:54:14,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2360c961[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:14,194 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:54:14,194 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,198 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,199 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:54:14,199 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:54:14,199 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:14,199 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,199 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:14,200 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,200 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:54:14,200 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:14,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,200 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:54:14,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:14,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:14,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:14,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:14,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:14,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:14,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:54:14,203 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:54:14,203 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:14,203 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:14,203 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,203 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:14,204 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,204 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:14,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:14,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,204 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:14,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:14,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:14,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:14,205 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:14,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,206 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:14,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,209 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,209 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,209 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,209 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:14,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:14,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:14,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:14,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:14,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-25 12:54:14,209 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:14,209 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:14,209 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,209 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:14,209 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:14,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:14,209 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:14,209 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,209 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,309 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:14,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:14,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:14,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:14,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,316 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:14,316 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:14,316 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:54:14,316 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:54:14,317 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,317 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,325 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,325 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:14,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:14,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:14,325 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:14,325 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:14,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:14,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,326 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,326 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:54:14,326 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:14,326 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:54:14,326 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:14,326 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:54:14,328 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:14,328 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:14,328 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:14,328 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. started... 2023-11-25 12:54:14,328 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e610b0aabe2bce69b899dd05ec92035a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:14,743 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ff4489d0300e4883903d5b9ef3199c01 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907ff4489d0300e4883903d5b9ef3199c01 2023-11-25 12:54:15,149 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/37404a2f39394544ae3b5eabad9106fb 2023-11-25 12:54:15,154 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/37404a2f39394544ae3b5eabad9106fb as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/37404a2f39394544ae3b5eabad9106fb 2023-11-25 12:54:15,158 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/37404a2f39394544ae3b5eabad9106fb, entries=1, sequenceid=37, filesize=4.9 K 2023-11-25 12:54:15,159 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e610b0aabe2bce69b899dd05ec92035a in 831ms, sequenceid=37, compaction requested=true 2023-11-25 12:54:15,159 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:15,159 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:15,159 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:15,159 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:15,159 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,159 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:54:15,159 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:54:15,161 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,161 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:15,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:15,161 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,161 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:15,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:15,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:15,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:15,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:54:15,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23b5e40c[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:15,163 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:54:15,163 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,164 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,164 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:54:15,164 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:54:15,164 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,165 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:15,164 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:15,167 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:54:15,167 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:15,167 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:54:15,167 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:15,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:15,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:15,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:15,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:15,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:15,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:54:15,170 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:54:15,170 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:15,170 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:15,170 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,170 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:15,171 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,171 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:15,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,171 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:15,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:15,172 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:15,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,174 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:15,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,176 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,176 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,176 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:15,176 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:15,176 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:15,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:15,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:15,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:15,176 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:15,176 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,176 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,176 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,177 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,177 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:15,177 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:15,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:15,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:15,277 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:15,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:15,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:15,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:15,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,284 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:15,284 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:15,284 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-25 12:54:15,284 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-25 12:54:15,285 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,285 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,286 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,286 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:15,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:15,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:15,287 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:15,287 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:15,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,287 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:15,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,288 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,288 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-25 12:54:15,288 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-25 12:54:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-25 12:54:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:15,288 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:15,288 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. started... 2023-11-25 12:54:15,289 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e610b0aabe2bce69b899dd05ec92035a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:15,702 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e01be7b0551f484092698f1df672c4b0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120e01be7b0551f484092698f1df672c4b0 2023-11-25 12:54:16,110 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/7eac410a6e274c0884c6435159c4d74b 2023-11-25 12:54:16,116 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/7eac410a6e274c0884c6435159c4d74b as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/7eac410a6e274c0884c6435159c4d74b 2023-11-25 12:54:16,120 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/7eac410a6e274c0884c6435159c4d74b, entries=1, sequenceid=41, filesize=4.9 K 2023-11-25 12:54:16,121 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e610b0aabe2bce69b899dd05ec92035a in 832ms, sequenceid=41, compaction requested=true 2023-11-25 12:54:16,121 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:16,121 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:16,121 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:16,121 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:16,121 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:16,121 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-25 12:54:16,121 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-25 12:54:16,123 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:16,123 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:16,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:16,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:16,124 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,124 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:16,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:16,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:16,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:16,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:16,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-25 12:54:16,125 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-25 12:54:16,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@531fe48d[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:16,126 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,127 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,127 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-25 12:54:16,127 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-25 12:54:16,127 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:16,127 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:16,127 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:16,128 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-25 12:54:16,128 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:16,128 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:16,129 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-25 12:54:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:16,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:16,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:16,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:16,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:54:16,131 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-25 12:54:16,131 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:16,131 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:16,131 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,131 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:16,133 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,133 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:16,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:16,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,133 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:16,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:16,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:16,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:16,134 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:16,135 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:16,140 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:16,140 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,140 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,140 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:16,140 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:16,140 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:16,140 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-25 12:54:16,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:16,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-25 12:54:16,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:16,140 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:16,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:16,141 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,141 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,141 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:16,141 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:16,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:16,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:16,241 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:16,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:16,244 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38201] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-25 12:54:16,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-25 12:54:16,246 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-25 12:54:16,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:16,247 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700917456247 2023-11-25 12:54:16,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-25 12:54:16,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-25 12:54:16,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-25 12:54:16,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] zookeeper.ReadOnlyZKClient(139): Connect 0x221b9d21 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:54:16,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e791eaf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:54:16,259 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:54:17,102 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103bdb31c065a5c4381b1f0c656eaa0181d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103bdb31c065a5c4381b1f0c656eaa0181d 2023-11-25 12:54:17,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-25 12:54:17,118 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:54:17,119 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:54:17,126 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:54:17,127 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:54:17,136 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5cbf9da737c04ee6a982f8037b26a0ff first=Optional[r3] last=Optional[r6] 2023-11-25 12:54:17,137 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5cbf9da737c04ee6a982f8037b26a0ff}] 2023-11-25 12:54:17,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5cbf9da737c04ee6a982f8037b26a0ff for inclusion in e610b0aabe2bce69b899dd05ec92035a/family1 2023-11-25 12:54:17,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-25 12:54:17,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:54:17,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:17,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5cbf9da737c04ee6a982f8037b26a0ff to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__dbn939jal94npdgpe68nk9mj4mtnq2c9rbcj04bi366pm83tj38r3p27phr8jndc/family1/5cbf9da737c04ee6a982f8037b26a0ff 2023-11-25 12:54:17,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__dbn939jal94npdgpe68nk9mj4mtnq2c9rbcj04bi366pm83tj38r3p27phr8jndc/family1/5cbf9da737c04ee6a982f8037b26a0ff as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/a5103cc3b0f946a0bb30d89de4f7a47c_SeqId_44_ 2023-11-25 12:54:17,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__dbn939jal94npdgpe68nk9mj4mtnq2c9rbcj04bi366pm83tj38r3p27phr8jndc/family1/5cbf9da737c04ee6a982f8037b26a0ff into e610b0aabe2bce69b899dd05ec92035a/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/a5103cc3b0f946a0bb30d89de4f7a47c_SeqId_44_ - updating store file list. 2023-11-25 12:54:17,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/a5103cc3b0f946a0bb30d89de4f7a47c_SeqId_44_ into e610b0aabe2bce69b899dd05ec92035a/family1 2023-11-25 12:54:17,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__dbn939jal94npdgpe68nk9mj4mtnq2c9rbcj04bi366pm83tj38r3p27phr8jndc/family1/5cbf9da737c04ee6a982f8037b26a0ff into e610b0aabe2bce69b899dd05ec92035a/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/a5103cc3b0f946a0bb30d89de4f7a47c_SeqId_44_) 2023-11-25 12:54:17,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__dbn939jal94npdgpe68nk9mj4mtnq2c9rbcj04bi366pm83tj38r3p27phr8jndc/family1/5cbf9da737c04ee6a982f8037b26a0ff 2023-11-25 12:54:17,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-25 12:54:17,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-25 12:54:17,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(1912): e610b0aabe2bce69b899dd05ec92035a/family1 is initiating minor compaction 2023-11-25 12:54:17,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@689c5151; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:17,156 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e610b0aabe2bce69b899dd05ec92035a/family1 in testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:17,156 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/000ce15dfbf842cc94d72bf414fc9ee8, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/52897544165844c7a50cf03bca47eb19, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/78ca080abeb14feaa4a839068a2b3a5f, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/aaa056aef7e84c8fa0c62424aceeeb3b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/a6adb7d186af4efd997f86758aa843e3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/3d1c4bc89ebf4f679bb8973efa55cb8c, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/9696a3c80dde4dcfb8c349d45a40fffb, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/37404a2f39394544ae3b5eabad9106fb, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/7eac410a6e274c0884c6435159c4d74b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/a5103cc3b0f946a0bb30d89de4f7a47c_SeqId_44_] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp, totalSize=50.0 K 2023-11-25 12:54:17,156 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 000ce15dfbf842cc94d72bf414fc9ee8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-25 12:54:17,156 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 52897544165844c7a50cf03bca47eb19, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-25 12:54:17,156 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 78ca080abeb14feaa4a839068a2b3a5f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-25 12:54:17,156 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting aaa056aef7e84c8fa0c62424aceeeb3b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-25 12:54:17,156 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting a6adb7d186af4efd997f86758aa843e3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-25 12:54:17,156 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 3d1c4bc89ebf4f679bb8973efa55cb8c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-25 12:54:17,156 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 9696a3c80dde4dcfb8c349d45a40fffb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-25 12:54:17,157 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 37404a2f39394544ae3b5eabad9106fb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-25 12:54:17,157 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 7eac410a6e274c0884c6435159c4d74b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-25 12:54:17,157 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting a5103cc3b0f946a0bb30d89de4f7a47c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-25 12:54:17,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-25 12:54:17,158 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:17,160 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122836cd8a0f27674a7891e15e658385676e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122836cd8a0f27674a7891e15e658385676e 2023-11-25 12:54:17,161 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231ff5ba819284640acab29dea679376df6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231ff5ba819284640acab29dea679376df6 2023-11-25 12:54:17,163 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601011b73e4656bea48e4b6993f3ee7ee7b28 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601011b73e4656bea48e4b6993f3ee7ee7b28 2023-11-25 12:54:17,164 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601033ece843d3710417cbaf4a5e1882a9ae2 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601033ece843d3710417cbaf4a5e1882a9ae2 2023-11-25 12:54:17,164 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-25 12:54:17,164 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-25 12:54:17,166 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:54:17,166 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:54:17,166 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:54:17,166 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:54:17,166 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:54:17,166 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:54:17,166 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:54:17,166 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:54:17,195 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): e610b0aabe2bce69b899dd05ec92035a#family1#compaction#47 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:54:18,013 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/9afcc89268e44196a7feeb805e8c57a5 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/9afcc89268e44196a7feeb805e8c57a5 2023-11-25 12:54:18,017 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e610b0aabe2bce69b899dd05ec92035a/family1 of e610b0aabe2bce69b899dd05ec92035a into 9afcc89268e44196a7feeb805e8c57a5(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:54:18,017 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:18,018 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700916857155; duration=0sec 2023-11-25 12:54:18,018 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:18,029 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051bf3fd1c47e24a298b90f14d045f470d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512051bf3fd1c47e24a298b90f14d045f470d 2023-11-25 12:54:18,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-25 12:54:18,063 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/000ce15dfbf842cc94d72bf414fc9ee8, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/52897544165844c7a50cf03bca47eb19, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/78ca080abeb14feaa4a839068a2b3a5f, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/aaa056aef7e84c8fa0c62424aceeeb3b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/a6adb7d186af4efd997f86758aa843e3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/3d1c4bc89ebf4f679bb8973efa55cb8c, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/9696a3c80dde4dcfb8c349d45a40fffb, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/37404a2f39394544ae3b5eabad9106fb, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/7eac410a6e274c0884c6435159c4d74b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/a5103cc3b0f946a0bb30d89de4f7a47c_SeqId_44_] to archive 2023-11-25 12:54:18,064 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:18,064 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/013daacb6d3d4eb58c893ca2b3fe9de7 first=Optional[r00] last=Optional[r2] 2023-11-25 12:54:18,065 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/013daacb6d3d4eb58c893ca2b3fe9de7}] 2023-11-25 12:54:18,067 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/000ce15dfbf842cc94d72bf414fc9ee8 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/000ce15dfbf842cc94d72bf414fc9ee8 2023-11-25 12:54:18,068 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/52897544165844c7a50cf03bca47eb19 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/52897544165844c7a50cf03bca47eb19 2023-11-25 12:54:18,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/78ca080abeb14feaa4a839068a2b3a5f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/78ca080abeb14feaa4a839068a2b3a5f 2023-11-25 12:54:18,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/013daacb6d3d4eb58c893ca2b3fe9de7 for inclusion in e610b0aabe2bce69b899dd05ec92035a/family1 2023-11-25 12:54:18,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/aaa056aef7e84c8fa0c62424aceeeb3b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/aaa056aef7e84c8fa0c62424aceeeb3b 2023-11-25 12:54:18,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/a6adb7d186af4efd997f86758aa843e3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/a6adb7d186af4efd997f86758aa843e3 2023-11-25 12:54:18,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-25 12:54:18,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:54:18,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:18,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/3d1c4bc89ebf4f679bb8973efa55cb8c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/3d1c4bc89ebf4f679bb8973efa55cb8c 2023-11-25 12:54:18,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/013daacb6d3d4eb58c893ca2b3fe9de7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__62qhqdafpoqumf918v1hkisr4quhd0ilv4q6a5jltm79bl5cmeio0aa1lvgb787u/family1/013daacb6d3d4eb58c893ca2b3fe9de7 2023-11-25 12:54:18,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/9696a3c80dde4dcfb8c349d45a40fffb to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/9696a3c80dde4dcfb8c349d45a40fffb 2023-11-25 12:54:18,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__62qhqdafpoqumf918v1hkisr4quhd0ilv4q6a5jltm79bl5cmeio0aa1lvgb787u/family1/013daacb6d3d4eb58c893ca2b3fe9de7 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/0b29be9662614a50a5b01025ba5dbade_SeqId_47_ 2023-11-25 12:54:18,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/37404a2f39394544ae3b5eabad9106fb to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/37404a2f39394544ae3b5eabad9106fb 2023-11-25 12:54:18,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__62qhqdafpoqumf918v1hkisr4quhd0ilv4q6a5jltm79bl5cmeio0aa1lvgb787u/family1/013daacb6d3d4eb58c893ca2b3fe9de7 into e610b0aabe2bce69b899dd05ec92035a/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/0b29be9662614a50a5b01025ba5dbade_SeqId_47_ - updating store file list. 2023-11-25 12:54:18,078 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/7eac410a6e274c0884c6435159c4d74b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/7eac410a6e274c0884c6435159c4d74b 2023-11-25 12:54:18,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/a5103cc3b0f946a0bb30d89de4f7a47c_SeqId_44_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/a5103cc3b0f946a0bb30d89de4f7a47c_SeqId_44_ 2023-11-25 12:54:18,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/0b29be9662614a50a5b01025ba5dbade_SeqId_47_ into e610b0aabe2bce69b899dd05ec92035a/family1 2023-11-25 12:54:18,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__62qhqdafpoqumf918v1hkisr4quhd0ilv4q6a5jltm79bl5cmeio0aa1lvgb787u/family1/013daacb6d3d4eb58c893ca2b3fe9de7 into e610b0aabe2bce69b899dd05ec92035a/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/0b29be9662614a50a5b01025ba5dbade_SeqId_47_) 2023-11-25 12:54:18,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__62qhqdafpoqumf918v1hkisr4quhd0ilv4q6a5jltm79bl5cmeio0aa1lvgb787u/family1/013daacb6d3d4eb58c893ca2b3fe9de7 2023-11-25 12:54:18,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-25 12:54:18,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-25 12:54:18,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(1912): e610b0aabe2bce69b899dd05ec92035a/family1 is initiating minor compaction (all files) 2023-11-25 12:54:18,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6081793d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:18,084 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e610b0aabe2bce69b899dd05ec92035a/family1 in testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:54:18,084 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/61ac8e36e8974903ba12425648416557, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/9afcc89268e44196a7feeb805e8c57a5, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/0b29be9662614a50a5b01025ba5dbade_SeqId_47_] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp, totalSize=337.0 K 2023-11-25 12:54:18,085 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 61ac8e36e8974903ba12425648416557, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878825182 2023-11-25 12:54:18,085 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 9afcc89268e44196a7feeb805e8c57a5, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621225182 2023-11-25 12:54:18,086 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 0b29be9662614a50a5b01025ba5dbade_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878825182 2023-11-25 12:54:18,086 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-25 12:54:18,087 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:18,090 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113005998d9cceb54f3e8e6ccf7794ea4ea4 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113005998d9cceb54f3e8e6ccf7794ea4ea4 2023-11-25 12:54:18,091 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011c723ae7e0944e84aed03b0e6db71160 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011c723ae7e0944e84aed03b0e6db71160 2023-11-25 12:54:18,093 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205df5afc2987ce49a5abd4aca1b76a9f59 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205df5afc2987ce49a5abd4aca1b76a9f59 2023-11-25 12:54:18,094 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-25 12:54:18,094 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-25 12:54:18,094 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-25 12:54:18,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-25 12:54:18,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:18,097 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-25 12:54:18,100 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8530 sec 2023-11-25 12:54:18,110 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): e610b0aabe2bce69b899dd05ec92035a#family1#compaction#48 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:54:18,216 INFO [Listener at localhost/45289] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=259 (was 249) - Thread LEAK? -, OpenFileDescriptor=648 (was 632) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=208 (was 238), ProcessCount=170 (was 170), AvailableMemoryMB=8152 (was 8160) 2023-11-25 12:54:18,228 INFO [Listener at localhost/45289] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=259, OpenFileDescriptor=648, MaxFileDescriptor=60000, SystemLoadAverage=208, ProcessCount=170, AvailableMemoryMB=8152 2023-11-25 12:54:18,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-25 12:54:18,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:18,233 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-25 12:54:18,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-25 12:54:18,234 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-25 12:54:18,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-25 12:54:18,235 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:18,236 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e empty. 2023-11-25 12:54:18,236 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:18,237 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-25 12:54:18,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-25 12:54:18,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-25 12:54:18,646 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-25 12:54:18,647 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => e8a9f5a78223694384a6169ce0365c9e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:54:18,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-25 12:54:19,054 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:19,054 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing e8a9f5a78223694384a6169ce0365c9e, disabling compactions & flushes 2023-11-25 12:54:19,054 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:19,054 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:19,054 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. after waiting 0 ms 2023-11-25 12:54:19,054 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:19,054 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:19,054 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:19,056 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-25 12:54:19,057 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700916859057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916859057"}]},"ts":"1700916859057"} 2023-11-25 12:54:19,059 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-25 12:54:19,060 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-25 12:54:19,060 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916859060"}]},"ts":"1700916859060"} 2023-11-25 12:54:19,061 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-25 12:54:19,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e8a9f5a78223694384a6169ce0365c9e, ASSIGN}] 2023-11-25 12:54:19,065 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e8a9f5a78223694384a6169ce0365c9e, ASSIGN 2023-11-25 12:54:19,066 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e8a9f5a78223694384a6169ce0365c9e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:54:19,217 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=e8a9f5a78223694384a6169ce0365c9e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:19,217 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700916859217"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916859217"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916859217"}]},"ts":"1700916859217"} 2023-11-25 12:54:19,219 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure e8a9f5a78223694384a6169ce0365c9e, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:19,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-25 12:54:19,342 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/.tmp/family1/08f0d0af9bba49a4849acd590c134ad0 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/08f0d0af9bba49a4849acd590c134ad0 2023-11-25 12:54:19,347 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e610b0aabe2bce69b899dd05ec92035a/family1 of e610b0aabe2bce69b899dd05ec92035a into 08f0d0af9bba49a4849acd590c134ad0(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:54:19,347 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:54:19,347 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1700916858084; duration=1sec 2023-11-25 12:54:19,347 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:19,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/61ac8e36e8974903ba12425648416557, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/9afcc89268e44196a7feeb805e8c57a5, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/0b29be9662614a50a5b01025ba5dbade_SeqId_47_] to archive 2023-11-25 12:54:19,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:19,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/61ac8e36e8974903ba12425648416557 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/61ac8e36e8974903ba12425648416557 2023-11-25 12:54:19,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/9afcc89268e44196a7feeb805e8c57a5 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/9afcc89268e44196a7feeb805e8c57a5 2023-11-25 12:54:19,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/0b29be9662614a50a5b01025ba5dbade_SeqId_47_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/family1/0b29be9662614a50a5b01025ba5dbade_SeqId_47_ 2023-11-25 12:54:19,371 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:19,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:19,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e8a9f5a78223694384a6169ce0365c9e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:54:19,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:19,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:19,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:19,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:19,375 INFO [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:19,376 DEBUG [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1 2023-11-25 12:54:19,376 DEBUG [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1 2023-11-25 12:54:19,377 INFO [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8a9f5a78223694384a6169ce0365c9e columnFamilyName family1 2023-11-25 12:54:19,378 INFO [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] regionserver.HStore(310): Store=e8a9f5a78223694384a6169ce0365c9e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:19,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:19,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:19,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:19,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:54:19,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e8a9f5a78223694384a6169ce0365c9e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73335249, jitterRate=0.09278036653995514}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-25 12:54:19,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:19,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e., pid=41, masterSystemTime=1700916859371 2023-11-25 12:54:19,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:19,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:19,387 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=e8a9f5a78223694384a6169ce0365c9e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:19,387 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700916859387"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916859387"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916859387"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916859387"}]},"ts":"1700916859387"} 2023-11-25 12:54:19,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=41, resume processing ppid=40 2023-11-25 12:54:19,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure e8a9f5a78223694384a6169ce0365c9e, server=jenkins-hbase4.apache.org,37051,1700916801082 in 169 msec 2023-11-25 12:54:19,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=40, resume processing ppid=39 2023-11-25 12:54:19,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e8a9f5a78223694384a6169ce0365c9e, ASSIGN in 326 msec 2023-11-25 12:54:19,392 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-25 12:54:19,392 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916859392"}]},"ts":"1700916859392"} 2023-11-25 12:54:19,393 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-25 12:54:19,397 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-25 12:54:19,398 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1670 sec 2023-11-25 12:54:20,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-25 12:54:20,339 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-25 12:54:20,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:20,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:20,360 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:20,360 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:20,360 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-25 12:54:20,360 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-25 12:54:20,361 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:20,361 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:20,362 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:20,362 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:20,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:20,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:20,363 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:20,363 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:20,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:20,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:20,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:20,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:20,364 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:20,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:20,364 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-25 12:54:20,364 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:20,364 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-25 12:54:20,366 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:20,366 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:20,366 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:20,366 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. started... 2023-11-25 12:54:20,367 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e8a9f5a78223694384a6169ce0365c9e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-25 12:54:20,787 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303a0f329dca8d483a88098ef606a05d52 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511303a0f329dca8d483a88098ef606a05d52 2023-11-25 12:54:21,192 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/3c22c28c4fc94f9dbde8c27c50c539ff 2023-11-25 12:54:21,197 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/3c22c28c4fc94f9dbde8c27c50c539ff as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/3c22c28c4fc94f9dbde8c27c50c539ff 2023-11-25 12:54:21,201 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/3c22c28c4fc94f9dbde8c27c50c539ff, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-25 12:54:21,202 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e8a9f5a78223694384a6169ce0365c9e in 835ms, sequenceid=5, compaction requested=false 2023-11-25 12:54:21,202 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:21,202 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:21,202 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:21,202 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:21,202 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:21,202 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,203 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-25 12:54:21,203 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-25 12:54:21,204 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,204 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:21,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:21,205 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,205 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:21,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-25 12:54:21,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2563487[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:21,206 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-25 12:54:21,206 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,208 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,208 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-25 12:54:21,208 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-25 12:54:21,208 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:21,208 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,208 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:21,211 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-25 12:54:21,211 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,211 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:21,211 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-25 12:54:21,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:21,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:21,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:21,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:21,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:21,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:21,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-25 12:54:21,214 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-25 12:54:21,214 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:21,214 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:21,214 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,214 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:21,215 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,215 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,216 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:21,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:21,216 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:21,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,217 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:21,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,220 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,220 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,220 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,220 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:21,220 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:21,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:21,220 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,220 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,220 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:21,220 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-25 12:54:21,220 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:21,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:21,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:21,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:21,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:21,220 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,221 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:21,221 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:21,321 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:21,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:21,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:21,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:21,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,327 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:21,327 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:21,327 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-25 12:54:21,327 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-25 12:54:21,328 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,328 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,329 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:21,329 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:21,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:21,330 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,330 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:21,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,330 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:21,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,331 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,331 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-25 12:54:21,331 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,331 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-25 12:54:21,331 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:21,331 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-25 12:54:21,331 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:21,331 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:21,331 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:21,331 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. started... 2023-11-25 12:54:21,331 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e8a9f5a78223694384a6169ce0365c9e 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-25 12:54:21,745 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112891e1179b50e44cd5abb0b0b09e17cba0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112891e1179b50e44cd5abb0b0b09e17cba0 2023-11-25 12:54:21,751 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/9c7a062e7212423abd97a9a557050899 2023-11-25 12:54:21,756 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/9c7a062e7212423abd97a9a557050899 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/9c7a062e7212423abd97a9a557050899 2023-11-25 12:54:21,761 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/9c7a062e7212423abd97a9a557050899, entries=1, sequenceid=9, filesize=5.0 K 2023-11-25 12:54:21,762 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e8a9f5a78223694384a6169ce0365c9e in 431ms, sequenceid=9, compaction requested=false 2023-11-25 12:54:21,762 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:21,762 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:21,762 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:21,762 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:21,762 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,762 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-25 12:54:21,762 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-25 12:54:21,765 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,765 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:21,766 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,766 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:21,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-25 12:54:21,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27d8ce6d[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:21,768 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-25 12:54:21,768 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,769 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,769 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-25 12:54:21,769 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-25 12:54:21,769 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:21,769 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,769 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:21,770 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,770 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-25 12:54:21,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:21,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:21,770 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:21,771 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-25 12:54:21,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:21,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:21,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:21,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:21,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-25 12:54:21,773 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-25 12:54:21,773 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:21,773 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:21,773 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,773 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:21,775 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,775 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:21,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:21,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,775 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:21,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:21,775 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:21,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:21,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:21,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,777 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:21,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,783 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,783 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:21,783 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:21,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:21,783 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:21,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:21,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:21,783 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:21,783 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-25 12:54:21,783 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,783 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,783 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:21,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:21,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:21,783 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:21,783 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,784 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,784 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,884 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:21,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:21,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:21,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:21,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,891 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:21,891 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:21,891 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-25 12:54:21,891 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-25 12:54:21,891 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,892 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,893 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:21,893 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:21,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:21,893 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:21,894 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:21,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:21,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,894 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,895 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-25 12:54:21,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-25 12:54:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-25 12:54:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:21,895 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:21,895 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. started... 2023-11-25 12:54:21,895 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e8a9f5a78223694384a6169ce0365c9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:22,312 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201625721966be74da485fe7cfe927ca44b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201625721966be74da485fe7cfe927ca44b 2023-11-25 12:54:22,644 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-11-25 12:54:22,717 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/bba82ede784a470aaf0da439738bac66 2023-11-25 12:54:22,724 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/bba82ede784a470aaf0da439738bac66 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/bba82ede784a470aaf0da439738bac66 2023-11-25 12:54:22,728 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/bba82ede784a470aaf0da439738bac66, entries=1, sequenceid=13, filesize=5.0 K 2023-11-25 12:54:22,729 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e8a9f5a78223694384a6169ce0365c9e in 834ms, sequenceid=13, compaction requested=true 2023-11-25 12:54:22,730 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:22,730 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:22,730 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:22,730 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:22,730 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,730 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-25 12:54:22,730 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-25 12:54:22,732 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,732 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:22,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:22,732 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:22,732 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:22,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:22,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:22,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-25 12:54:22,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b41db1e[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:22,734 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-25 12:54:22,734 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,737 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,737 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-25 12:54:22,737 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-25 12:54:22,737 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:22,737 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,737 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:22,738 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-25 12:54:22,738 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,738 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:22,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:22,738 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-25 12:54:22,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:22,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:22,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:22,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:22,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:22,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-25 12:54:22,741 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-25 12:54:22,741 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:22,741 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:22,741 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,741 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:22,743 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,743 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:22,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:22,743 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:22,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:22,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:22,744 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:22,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:22,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,745 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:22,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,747 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,747 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,747 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:22,747 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:22,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:22,747 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:22,747 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,747 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:22,747 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-25 12:54:22,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:22,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:22,748 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:22,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:22,748 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,748 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:22,748 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:22,848 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:22,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:22,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:22,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:22,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,855 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:22,855 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:22,855 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-25 12:54:22,855 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-25 12:54:22,856 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,856 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,858 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:22,858 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:22,858 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,858 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:22,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,859 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,859 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-25 12:54:22,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:22,859 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-25 12:54:22,860 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:22,860 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-25 12:54:22,860 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:22,860 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:22,860 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:22,860 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. started... 2023-11-25 12:54:22,860 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e8a9f5a78223694384a6169ce0365c9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:23,272 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a869d1a8374f428cad6708ea646a96f1 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a869d1a8374f428cad6708ea646a96f1 2023-11-25 12:54:23,678 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/162a7244292f486ba963f4420ec7eb55 2023-11-25 12:54:23,685 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/162a7244292f486ba963f4420ec7eb55 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/162a7244292f486ba963f4420ec7eb55 2023-11-25 12:54:23,691 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/162a7244292f486ba963f4420ec7eb55, entries=1, sequenceid=17, filesize=5.0 K 2023-11-25 12:54:23,692 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e8a9f5a78223694384a6169ce0365c9e in 832ms, sequenceid=17, compaction requested=true 2023-11-25 12:54:23,692 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:23,692 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:23,692 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:23,692 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:23,692 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,692 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-25 12:54:23,692 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-25 12:54:23,694 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,694 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:23,694 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,694 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:23,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:23,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-25 12:54:23,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d66977[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:23,696 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-25 12:54:23,696 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,697 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,697 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-25 12:54:23,697 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-25 12:54:23,697 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:23,697 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,697 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:23,699 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-25 12:54:23,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:23,700 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:23,700 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-25 12:54:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:23,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-25 12:54:23,702 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-25 12:54:23,702 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:23,702 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:23,702 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,702 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:23,704 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,704 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:23,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,704 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:23,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:23,705 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,706 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,708 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,709 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:23,709 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:23,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:23,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:23,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:23,709 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:23,709 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:23,709 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:23,709 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:23,709 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:23,709 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:23,709 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,709 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,709 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,809 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:23,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:23,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:23,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:23,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,816 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:23,816 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:23,816 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-25 12:54:23,816 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-25 12:54:23,817 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,817 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,818 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,818 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:23,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:23,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:23,819 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:23,819 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:23,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:23,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,820 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,820 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-25 12:54:23,820 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:23,820 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-25 12:54:23,820 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:23,820 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-25 12:54:23,820 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:23,820 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:23,820 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:23,821 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. started... 2023-11-25 12:54:23,821 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e8a9f5a78223694384a6169ce0365c9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:24,233 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122831e64b7ff5744d139f2158bc96b3323c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122831e64b7ff5744d139f2158bc96b3323c 2023-11-25 12:54:24,639 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/2dd654586eb04d16b244adb0fc234077 2023-11-25 12:54:24,644 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/2dd654586eb04d16b244adb0fc234077 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/2dd654586eb04d16b244adb0fc234077 2023-11-25 12:54:24,648 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/2dd654586eb04d16b244adb0fc234077, entries=1, sequenceid=21, filesize=5.0 K 2023-11-25 12:54:24,649 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e8a9f5a78223694384a6169ce0365c9e in 828ms, sequenceid=21, compaction requested=true 2023-11-25 12:54:24,650 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:24,650 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:24,650 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:24,650 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:24,650 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,650 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-25 12:54:24,650 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-25 12:54:24,655 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,655 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:24,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:24,655 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,655 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:24,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-25 12:54:24,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34178706[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:24,657 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-25 12:54:24,657 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,659 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,659 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-25 12:54:24,659 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-25 12:54:24,659 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:24,659 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,660 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:24,661 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-25 12:54:24,661 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,661 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:24,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:24,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:24,661 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-25 12:54:24,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:24,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:24,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:24,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:24,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-25 12:54:24,663 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-25 12:54:24,663 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:24,663 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:24,663 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,663 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:24,665 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,665 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,665 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:24,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:24,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:24,666 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,667 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,671 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,671 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,671 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,671 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,671 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,671 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:24,671 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:24,671 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:24,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:24,671 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:24,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:24,671 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:24,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:24,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:24,672 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:24,672 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:24,772 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:24,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:24,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:24,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:24,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,778 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:24,778 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:24,778 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-25 12:54:24,779 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-25 12:54:24,779 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,779 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,780 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,780 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:24,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:24,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:24,781 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:24,781 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:24,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:24,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,782 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,782 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-25 12:54:24,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:24,782 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-25 12:54:24,782 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:24,782 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-25 12:54:24,782 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:24,782 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:24,782 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:24,782 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. started... 2023-11-25 12:54:24,782 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e8a9f5a78223694384a6169ce0365c9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:24,906 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-25 12:54:25,196 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123137f3a03a7fae4892acf933f1ba9dc5b6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123137f3a03a7fae4892acf933f1ba9dc5b6 2023-11-25 12:54:25,602 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/8c0d1452eaca4fcd8dbc106e04320d6c 2023-11-25 12:54:25,608 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/8c0d1452eaca4fcd8dbc106e04320d6c as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/8c0d1452eaca4fcd8dbc106e04320d6c 2023-11-25 12:54:25,612 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/8c0d1452eaca4fcd8dbc106e04320d6c, entries=1, sequenceid=25, filesize=5.0 K 2023-11-25 12:54:25,613 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e8a9f5a78223694384a6169ce0365c9e in 831ms, sequenceid=25, compaction requested=true 2023-11-25 12:54:25,613 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:25,613 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:25,613 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:25,613 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:25,613 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,613 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-25 12:54:25,613 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-25 12:54:25,615 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,615 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:25,615 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,616 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:25,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-25 12:54:25,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@555d9c4f[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:25,617 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-25 12:54:25,617 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,618 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,619 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-25 12:54:25,619 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-25 12:54:25,619 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,619 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:25,619 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:25,621 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-25 12:54:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-25 12:54:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:25,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:25,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:25,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:25,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-25 12:54:25,624 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-25 12:54:25,624 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:25,624 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:25,624 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,624 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:25,626 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,626 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,626 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:25,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:25,626 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:25,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,628 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,630 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:25,630 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:25,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:25,630 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-25 12:54:25,630 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:25,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:25,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:25,630 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:25,630 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,631 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,631 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,631 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,631 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:25,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:25,631 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:25,631 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:25,731 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:25,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:25,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:25,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:25,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,738 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:25,738 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:25,738 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-25 12:54:25,738 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-25 12:54:25,738 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,738 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,740 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,740 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:25,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:25,740 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:25,740 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,741 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,741 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-25 12:54:25,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:25,741 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-25 12:54:25,741 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:25,741 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-25 12:54:25,741 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:25,741 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:25,741 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:25,741 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. started... 2023-11-25 12:54:25,741 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e8a9f5a78223694384a6169ce0365c9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:26,154 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a49e09dce9e74bdca52b2b4c3f7c45b3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101a49e09dce9e74bdca52b2b4c3f7c45b3 2023-11-25 12:54:26,561 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/095c65409b414e77bc70c06f44dc0aaf 2023-11-25 12:54:26,566 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/095c65409b414e77bc70c06f44dc0aaf as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/095c65409b414e77bc70c06f44dc0aaf 2023-11-25 12:54:26,571 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/095c65409b414e77bc70c06f44dc0aaf, entries=1, sequenceid=29, filesize=5.0 K 2023-11-25 12:54:26,572 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e8a9f5a78223694384a6169ce0365c9e in 831ms, sequenceid=29, compaction requested=true 2023-11-25 12:54:26,572 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:26,572 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:26,572 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:26,572 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:26,572 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,572 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-25 12:54:26,572 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-25 12:54:26,574 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,574 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:26,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:26,574 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,574 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:26,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:26,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:26,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:26,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-25 12:54:26,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70e124d1[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:26,576 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-25 12:54:26,576 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,577 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,577 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-25 12:54:26,577 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-25 12:54:26,577 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:26,577 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,577 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:26,587 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-25 12:54:26,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:26,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-25 12:54:26,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:26,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:26,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:26,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-25 12:54:26,589 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-25 12:54:26,589 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:26,589 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:26,589 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,589 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:26,591 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,591 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:26,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:26,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,591 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:26,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:26,592 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:26,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:26,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:26,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,593 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:26,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,596 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,596 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,596 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,596 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,596 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,596 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,596 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:26,596 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:26,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:26,596 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:26,596 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:26,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:26,596 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:26,596 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:26,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:26,697 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:26,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:26,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:26,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:26,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,703 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:26,703 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:26,703 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-25 12:54:26,703 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-25 12:54:26,704 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,704 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,705 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,705 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:26,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:26,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:26,705 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:26,706 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:26,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:26,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,706 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,707 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-25 12:54:26,707 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:26,707 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-25 12:54:26,707 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:26,707 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-25 12:54:26,707 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:26,707 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:26,707 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:26,707 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. started... 2023-11-25 12:54:26,707 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e8a9f5a78223694384a6169ce0365c9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:27,123 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034c8e0126afdf449da49e4fb7aea29b6a to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601034c8e0126afdf449da49e4fb7aea29b6a 2023-11-25 12:54:27,529 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/957023924b37470cbee823d5f5b64d97 2023-11-25 12:54:27,534 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/957023924b37470cbee823d5f5b64d97 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/957023924b37470cbee823d5f5b64d97 2023-11-25 12:54:27,538 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/957023924b37470cbee823d5f5b64d97, entries=1, sequenceid=33, filesize=5.0 K 2023-11-25 12:54:27,539 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e8a9f5a78223694384a6169ce0365c9e in 832ms, sequenceid=33, compaction requested=true 2023-11-25 12:54:27,539 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:27,539 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:27,539 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:27,539 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:27,540 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,540 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-25 12:54:27,540 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-25 12:54:27,542 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,542 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:27,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:27,543 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,543 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:27,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:27,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:27,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:27,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-25 12:54:27,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4448666b[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:27,545 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-25 12:54:27,545 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,546 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,546 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-25 12:54:27,546 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-25 12:54:27,546 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:27,547 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,547 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:27,548 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-25 12:54:27,548 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,548 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:27,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,548 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-25 12:54:27,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:27,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:27,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:27,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:27,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:27,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:27,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-25 12:54:27,551 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-25 12:54:27,551 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:27,551 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:27,551 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,551 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:27,553 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,553 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:27,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,553 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:27,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:27,553 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,555 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:27,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,558 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,558 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:27,558 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:27,558 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:27,558 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,558 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:27,558 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:27,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:27,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:27,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-25 12:54:27,558 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,559 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,559 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,559 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:27,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:27,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:27,559 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:27,659 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:27,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:27,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:27,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:27,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,666 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:27,666 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:27,666 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-25 12:54:27,666 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-25 12:54:27,667 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,667 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,668 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,668 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:27,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:27,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:27,669 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:27,669 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:27,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:27,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,669 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,670 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-25 12:54:27,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:27,670 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-25 12:54:27,670 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:27,670 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-25 12:54:27,670 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:27,670 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:27,670 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:27,670 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. started... 2023-11-25 12:54:27,670 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e8a9f5a78223694384a6169ce0365c9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:28,087 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907cf643151d4c74190bee2be459960f4d3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907cf643151d4c74190bee2be459960f4d3 2023-11-25 12:54:28,097 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/0695a8c6f7534428b4ffea86574256d6 2023-11-25 12:54:28,101 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/0695a8c6f7534428b4ffea86574256d6 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/0695a8c6f7534428b4ffea86574256d6 2023-11-25 12:54:28,106 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/0695a8c6f7534428b4ffea86574256d6, entries=1, sequenceid=37, filesize=5.0 K 2023-11-25 12:54:28,106 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e8a9f5a78223694384a6169ce0365c9e in 436ms, sequenceid=37, compaction requested=true 2023-11-25 12:54:28,106 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:28,107 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:28,107 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:28,107 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:28,107 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,107 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-25 12:54:28,107 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-25 12:54:28,108 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,108 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:28,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:28,109 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,109 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:28,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:28,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:28,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:28,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-25 12:54:28,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c6ff653[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:28,110 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-25 12:54:28,110 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,111 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,112 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-25 12:54:28,112 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-25 12:54:28,112 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:28,112 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,112 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:28,114 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-25 12:54:28,114 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:28,114 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,114 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-25 12:54:28,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:28,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:28,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:28,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:28,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:28,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:28,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-25 12:54:28,117 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-25 12:54:28,117 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:28,117 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:28,117 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,117 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:28,118 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,118 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:28,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:28,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,118 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:28,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:28,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:28,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:28,119 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:28,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,120 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:28,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,125 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,125 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,125 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,125 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,125 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,125 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:28,125 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,125 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:28,125 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:28,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:28,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:28,125 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:28,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:28,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:28,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:28,126 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:28,126 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:28,226 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:28,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:28,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:28,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:28,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,233 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:28,233 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:28,233 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-25 12:54:28,233 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-25 12:54:28,233 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,234 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,235 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,235 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:28,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:28,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:28,236 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:28,236 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:28,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,236 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,237 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,237 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-25 12:54:28,237 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:28,237 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-25 12:54:28,237 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:28,237 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-25 12:54:28,238 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:28,238 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:28,238 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:28,238 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. started... 2023-11-25 12:54:28,238 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e8a9f5a78223694384a6169ce0365c9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:28,650 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ddc8dd887e4343a4a5e9a46334fb3fd7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120ddc8dd887e4343a4a5e9a46334fb3fd7 2023-11-25 12:54:29,056 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/174597d6406b43bfbd31bc15632fce2d 2023-11-25 12:54:29,062 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/174597d6406b43bfbd31bc15632fce2d as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/174597d6406b43bfbd31bc15632fce2d 2023-11-25 12:54:29,066 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/174597d6406b43bfbd31bc15632fce2d, entries=1, sequenceid=41, filesize=5.0 K 2023-11-25 12:54:29,067 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e8a9f5a78223694384a6169ce0365c9e in 829ms, sequenceid=41, compaction requested=true 2023-11-25 12:54:29,067 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:29,067 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-25 12:54:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-25 12:54:29,069 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:29,069 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:29,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:29,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:29,069 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,069 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:29,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:29,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:29,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:29,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:29,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-25 12:54:29,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7569a475[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:29,071 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-25 12:54:29,071 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,072 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,072 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-25 12:54:29,072 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-25 12:54:29,072 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:29,072 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:29,072 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:29,074 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-25 12:54:29,074 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:29,074 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:29,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:29,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:29,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:29,074 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-25 12:54:29,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:29,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:29,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:29,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:29,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:29,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:29,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-25 12:54:29,076 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-25 12:54:29,077 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:29,077 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:29,077 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,077 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:29,079 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,079 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:29,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,079 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:29,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:29,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:29,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:29,080 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:29,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:29,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:29,082 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:29,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:29,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:29,084 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:29,084 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:29,084 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,084 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,085 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:29,085 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:29,085 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-25 12:54:29,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:29,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:29,085 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,085 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:29,085 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:29,085 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:29,085 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:29,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:29,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:29,185 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:29,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:29,188 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38201] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:29,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-25 12:54:29,191 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-25 12:54:29,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:29,191 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700917469191 2023-11-25 12:54:29,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-25 12:54:29,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-25 12:54:29,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-25 12:54:29,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] zookeeper.ReadOnlyZKClient(139): Connect 0x3015a840 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:54:29,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56da28d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:54:29,203 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:30,044 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103677d2f9aa8ce48d794e54f66e0e63840 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103677d2f9aa8ce48d794e54f66e0e63840 2023-11-25 12:54:30,045 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-25 12:54:30,059 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:54:30,060 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:54:30,067 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:54:30,068 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:54:30,077 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d3bac68b81f1458496cb477d6f6942d0 first=Optional[r3] last=Optional[r6] 2023-11-25 12:54:30,077 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d3bac68b81f1458496cb477d6f6942d0}] 2023-11-25 12:54:30,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d3bac68b81f1458496cb477d6f6942d0 for inclusion in e8a9f5a78223694384a6169ce0365c9e/family1 2023-11-25 12:54:30,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-25 12:54:30,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:54:30,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:30,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d3bac68b81f1458496cb477d6f6942d0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__tovs1ppo2bjoiqn0gqgviqqks9568j2nkk3b5c2lmjqmafu16r7vmaj1il0fq4gm/family1/d3bac68b81f1458496cb477d6f6942d0 2023-11-25 12:54:30,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__tovs1ppo2bjoiqn0gqgviqqks9568j2nkk3b5c2lmjqmafu16r7vmaj1il0fq4gm/family1/d3bac68b81f1458496cb477d6f6942d0 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/1e31ac541aa24fea93addf4ef5d2a4f4_SeqId_44_ 2023-11-25 12:54:30,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__tovs1ppo2bjoiqn0gqgviqqks9568j2nkk3b5c2lmjqmafu16r7vmaj1il0fq4gm/family1/d3bac68b81f1458496cb477d6f6942d0 into e8a9f5a78223694384a6169ce0365c9e/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/1e31ac541aa24fea93addf4ef5d2a4f4_SeqId_44_ - updating store file list. 2023-11-25 12:54:30,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/1e31ac541aa24fea93addf4ef5d2a4f4_SeqId_44_ into e8a9f5a78223694384a6169ce0365c9e/family1 2023-11-25 12:54:30,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__tovs1ppo2bjoiqn0gqgviqqks9568j2nkk3b5c2lmjqmafu16r7vmaj1il0fq4gm/family1/d3bac68b81f1458496cb477d6f6942d0 into e8a9f5a78223694384a6169ce0365c9e/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/1e31ac541aa24fea93addf4ef5d2a4f4_SeqId_44_) 2023-11-25 12:54:30,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__tovs1ppo2bjoiqn0gqgviqqks9568j2nkk3b5c2lmjqmafu16r7vmaj1il0fq4gm/family1/d3bac68b81f1458496cb477d6f6942d0 2023-11-25 12:54:30,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-25 12:54:30,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-25 12:54:30,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(1912): e8a9f5a78223694384a6169ce0365c9e/family1 is initiating minor compaction 2023-11-25 12:54:30,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1b2764a2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:30,096 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e8a9f5a78223694384a6169ce0365c9e/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:30,096 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/9c7a062e7212423abd97a9a557050899, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/bba82ede784a470aaf0da439738bac66, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/162a7244292f486ba963f4420ec7eb55, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/2dd654586eb04d16b244adb0fc234077, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/8c0d1452eaca4fcd8dbc106e04320d6c, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/095c65409b414e77bc70c06f44dc0aaf, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/957023924b37470cbee823d5f5b64d97, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/0695a8c6f7534428b4ffea86574256d6, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/174597d6406b43bfbd31bc15632fce2d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/1e31ac541aa24fea93addf4ef5d2a4f4_SeqId_44_] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp, totalSize=50.4 K 2023-11-25 12:54:30,097 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 9c7a062e7212423abd97a9a557050899, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-25 12:54:30,097 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting bba82ede784a470aaf0da439738bac66, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-25 12:54:30,097 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 162a7244292f486ba963f4420ec7eb55, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-25 12:54:30,097 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 2dd654586eb04d16b244adb0fc234077, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-25 12:54:30,097 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 8c0d1452eaca4fcd8dbc106e04320d6c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-25 12:54:30,097 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 095c65409b414e77bc70c06f44dc0aaf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-25 12:54:30,097 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 957023924b37470cbee823d5f5b64d97, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-25 12:54:30,097 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 0695a8c6f7534428b4ffea86574256d6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-25 12:54:30,097 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 174597d6406b43bfbd31bc15632fce2d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-25 12:54:30,097 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 1e31ac541aa24fea93addf4ef5d2a4f4_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-25 12:54:30,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-25 12:54:30,099 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:30,100 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122831e64b7ff5744d139f2158bc96b3323c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122831e64b7ff5744d139f2158bc96b3323c 2023-11-25 12:54:30,102 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123137f3a03a7fae4892acf933f1ba9dc5b6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123137f3a03a7fae4892acf933f1ba9dc5b6 2023-11-25 12:54:30,103 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101a49e09dce9e74bdca52b2b4c3f7c45b3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101a49e09dce9e74bdca52b2b4c3f7c45b3 2023-11-25 12:54:30,104 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601034c8e0126afdf449da49e4fb7aea29b6a to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601034c8e0126afdf449da49e4fb7aea29b6a 2023-11-25 12:54:30,104 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-25 12:54:30,104 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-25 12:54:30,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:30,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:30,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:30,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:30,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:30,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:30,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:30,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:30,137 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): e8a9f5a78223694384a6169ce0365c9e#family1#compaction#59 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-25 12:54:30,169 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120521b93af813f64ef58943716bc0996ca8 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120521b93af813f64ef58943716bc0996ca8 2023-11-25 12:54:30,170 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-25 12:54:30,195 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a567ec6cf7c24c089a08933ca9a32567 first=Optional[r00] last=Optional[r2] 2023-11-25 12:54:30,196 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a567ec6cf7c24c089a08933ca9a32567}] 2023-11-25 12:54:30,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a567ec6cf7c24c089a08933ca9a32567 for inclusion in e8a9f5a78223694384a6169ce0365c9e/family1 2023-11-25 12:54:30,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-25 12:54:30,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:54:30,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:30,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a567ec6cf7c24c089a08933ca9a32567 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rdl1up1423prguk693qet1und7tb12juo0a4smdvfq3tdlp5rs0hsd2bul0dsrmc/family1/a567ec6cf7c24c089a08933ca9a32567 2023-11-25 12:54:30,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rdl1up1423prguk693qet1und7tb12juo0a4smdvfq3tdlp5rs0hsd2bul0dsrmc/family1/a567ec6cf7c24c089a08933ca9a32567 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/68edacec90554df385675a34d137b206_SeqId_46_ 2023-11-25 12:54:30,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rdl1up1423prguk693qet1und7tb12juo0a4smdvfq3tdlp5rs0hsd2bul0dsrmc/family1/a567ec6cf7c24c089a08933ca9a32567 into e8a9f5a78223694384a6169ce0365c9e/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/68edacec90554df385675a34d137b206_SeqId_46_ - updating store file list. 2023-11-25 12:54:30,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/68edacec90554df385675a34d137b206_SeqId_46_ into e8a9f5a78223694384a6169ce0365c9e/family1 2023-11-25 12:54:30,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rdl1up1423prguk693qet1und7tb12juo0a4smdvfq3tdlp5rs0hsd2bul0dsrmc/family1/a567ec6cf7c24c089a08933ca9a32567 into e8a9f5a78223694384a6169ce0365c9e/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/68edacec90554df385675a34d137b206_SeqId_46_) 2023-11-25 12:54:30,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rdl1up1423prguk693qet1und7tb12juo0a4smdvfq3tdlp5rs0hsd2bul0dsrmc/family1/a567ec6cf7c24c089a08933ca9a32567 2023-11-25 12:54:30,211 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-25 12:54:30,211 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:30,213 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511303a0f329dca8d483a88098ef606a05d52 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511303a0f329dca8d483a88098ef606a05d52 2023-11-25 12:54:30,214 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201625721966be74da485fe7cfe927ca44b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201625721966be74da485fe7cfe927ca44b 2023-11-25 12:54:30,215 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a869d1a8374f428cad6708ea646a96f1 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a869d1a8374f428cad6708ea646a96f1 2023-11-25 12:54:30,216 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-25 12:54:30,216 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-25 12:54:30,217 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:30,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-25 12:54:30,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:30,218 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-25 12:54:30,219 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.0290 sec 2023-11-25 12:54:30,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-25 12:54:30,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:30,725 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-25 12:54:30,726 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-25 12:54:30,726 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-25 12:54:30,728 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-25 12:54:30,731 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e8a9f5a78223694384a6169ce0365c9e, REOPEN/MOVE}] 2023-11-25 12:54:30,732 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e8a9f5a78223694384a6169ce0365c9e, REOPEN/MOVE 2023-11-25 12:54:30,732 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e8a9f5a78223694384a6169ce0365c9e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:30,732 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700916870732"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916870732"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916870732"}]},"ts":"1700916870732"} 2023-11-25 12:54:30,734 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure e8a9f5a78223694384a6169ce0365c9e, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:30,885 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:30,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:30,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e8a9f5a78223694384a6169ce0365c9e, disabling compactions & flushes 2023-11-25 12:54:30,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:30,957 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/137501b9db22468f83be26852bb5882a as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/137501b9db22468f83be26852bb5882a 2023-11-25 12:54:30,962 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e8a9f5a78223694384a6169ce0365c9e/family1 of e8a9f5a78223694384a6169ce0365c9e into 137501b9db22468f83be26852bb5882a(size=6.8 K), total size for store is 390.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:54:30,962 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:30,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:30,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:30,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. after waiting 0 ms 2023-11-25 12:54:30,962 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700916870096; duration=0sec 2023-11-25 12:54:30,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:30,962 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:30,970 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/9c7a062e7212423abd97a9a557050899, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/bba82ede784a470aaf0da439738bac66, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/162a7244292f486ba963f4420ec7eb55, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/2dd654586eb04d16b244adb0fc234077, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/8c0d1452eaca4fcd8dbc106e04320d6c, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/095c65409b414e77bc70c06f44dc0aaf, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/957023924b37470cbee823d5f5b64d97, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/0695a8c6f7534428b4ffea86574256d6, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/174597d6406b43bfbd31bc15632fce2d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/1e31ac541aa24fea93addf4ef5d2a4f4_SeqId_44_] to archive 2023-11-25 12:54:30,971 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:30,973 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/9c7a062e7212423abd97a9a557050899 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/9c7a062e7212423abd97a9a557050899 2023-11-25 12:54:30,974 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/bba82ede784a470aaf0da439738bac66 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/bba82ede784a470aaf0da439738bac66 2023-11-25 12:54:30,975 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/162a7244292f486ba963f4420ec7eb55 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/162a7244292f486ba963f4420ec7eb55 2023-11-25 12:54:30,976 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/2dd654586eb04d16b244adb0fc234077 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/2dd654586eb04d16b244adb0fc234077 2023-11-25 12:54:30,977 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/8c0d1452eaca4fcd8dbc106e04320d6c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/8c0d1452eaca4fcd8dbc106e04320d6c 2023-11-25 12:54:30,978 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/095c65409b414e77bc70c06f44dc0aaf to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/095c65409b414e77bc70c06f44dc0aaf 2023-11-25 12:54:30,979 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/957023924b37470cbee823d5f5b64d97 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/957023924b37470cbee823d5f5b64d97 2023-11-25 12:54:30,980 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/0695a8c6f7534428b4ffea86574256d6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/0695a8c6f7534428b4ffea86574256d6 2023-11-25 12:54:30,981 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/174597d6406b43bfbd31bc15632fce2d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/174597d6406b43bfbd31bc15632fce2d 2023-11-25 12:54:30,982 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/1e31ac541aa24fea93addf4ef5d2a4f4_SeqId_44_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/1e31ac541aa24fea93addf4ef5d2a4f4_SeqId_44_ 2023-11-25 12:54:30,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-25 12:54:30,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:30,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:30,987 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: e8a9f5a78223694384a6169ce0365c9e to self. 2023-11-25 12:54:30,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:30,989 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e8a9f5a78223694384a6169ce0365c9e, regionState=CLOSED 2023-11-25 12:54:30,989 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700916870989"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916870989"}]},"ts":"1700916870989"} 2023-11-25 12:54:30,992 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=46, resume processing ppid=45 2023-11-25 12:54:30,992 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure e8a9f5a78223694384a6169ce0365c9e, server=jenkins-hbase4.apache.org,37051,1700916801082 in 257 msec 2023-11-25 12:54:30,992 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e8a9f5a78223694384a6169ce0365c9e, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=true 2023-11-25 12:54:31,143 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e8a9f5a78223694384a6169ce0365c9e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:31,143 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700916871143"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916871143"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916871143"}]},"ts":"1700916871143"} 2023-11-25 12:54:31,145 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure e8a9f5a78223694384a6169ce0365c9e, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:31,296 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:31,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:31,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e8a9f5a78223694384a6169ce0365c9e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:54:31,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:31,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:31,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:31,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:31,301 INFO [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:31,302 DEBUG [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1 2023-11-25 12:54:31,303 DEBUG [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1 2023-11-25 12:54:31,303 INFO [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8a9f5a78223694384a6169ce0365c9e columnFamilyName family1 2023-11-25 12:54:31,309 DEBUG [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/137501b9db22468f83be26852bb5882a 2023-11-25 12:54:31,313 DEBUG [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/3c22c28c4fc94f9dbde8c27c50c539ff 2023-11-25 12:54:31,317 DEBUG [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/68edacec90554df385675a34d137b206_SeqId_46_ 2023-11-25 12:54:31,317 INFO [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] regionserver.HStore(310): Store=e8a9f5a78223694384a6169ce0365c9e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:31,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:31,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:31,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:31,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e8a9f5a78223694384a6169ce0365c9e; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75228936, jitterRate=0.12099850177764893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-25 12:54:31,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:31,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e., pid=47, masterSystemTime=1700916871296 2023-11-25 12:54:31,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:31,324 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-25 12:54:31,326 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-25 12:54:31,326 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1912): e8a9f5a78223694384a6169ce0365c9e/family1 is initiating minor compaction (all files) 2023-11-25 12:54:31,326 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e8a9f5a78223694384a6169ce0365c9e/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:31,326 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/3c22c28c4fc94f9dbde8c27c50c539ff, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/137501b9db22468f83be26852bb5882a, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/68edacec90554df385675a34d137b206_SeqId_46_] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp, totalSize=390.1 K 2023-11-25 12:54:31,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:31,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:31,326 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 3c22c28c4fc94f9dbde8c27c50c539ff, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878825182 2023-11-25 12:54:31,326 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e8a9f5a78223694384a6169ce0365c9e, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:31,327 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700916871326"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916871326"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916871326"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916871326"}]},"ts":"1700916871326"} 2023-11-25 12:54:31,327 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 137501b9db22468f83be26852bb5882a, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621225182 2023-11-25 12:54:31,327 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 68edacec90554df385675a34d137b206_SeqId_46_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878825182 2023-11-25 12:54:31,329 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=47, resume processing ppid=45 2023-11-25 12:54:31,329 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure e8a9f5a78223694384a6169ce0365c9e, server=jenkins-hbase4.apache.org,37051,1700916801082 in 183 msec 2023-11-25 12:54:31,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=45, resume processing ppid=44 2023-11-25 12:54:31,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e8a9f5a78223694384a6169ce0365c9e, REOPEN/MOVE in 598 msec 2023-11-25 12:54:31,333 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=44, resume processing ppid=43 2023-11-25 12:54:31,333 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 604 msec 2023-11-25 12:54:31,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0190 sec 2023-11-25 12:54:31,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-25 12:54:31,338 INFO [Listener at localhost/45289] compactions.TestMobCompactor(278): alter status finished 2023-11-25 12:54:31,339 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38201] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:31,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-25 12:54:31,342 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-25 12:54:31,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:31,342 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700917471342 2023-11-25 12:54:31,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-25 12:54:31,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-25 12:54:31,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-25 12:54:31,344 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): e8a9f5a78223694384a6169ce0365c9e#family1#compaction#60 average throughput is 18.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-25 12:54:31,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] zookeeper.ReadOnlyZKClient(139): Connect 0x56c4e327 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:54:31,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51dfeda3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:54:31,365 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:31,365 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:31,365 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:31,365 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:31,366 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:31,794 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c936e3d8db6e474cb8d4f73b9de16a77 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128c936e3d8db6e474cb8d4f73b9de16a77 2023-11-25 12:54:31,795 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-25 12:54:31,808 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:54:31,809 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:54:31,816 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:54:31,818 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:54:31,826 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b01df4b2f2f044989cd6fb5b213f54b1 first=Optional[r05] last=Optional[r8] 2023-11-25 12:54:31,827 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=50 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b01df4b2f2f044989cd6fb5b213f54b1}] 2023-11-25 12:54:31,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b01df4b2f2f044989cd6fb5b213f54b1 for inclusion in e8a9f5a78223694384a6169ce0365c9e/family1 2023-11-25 12:54:31,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-25 12:54:31,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:54:31,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:31,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b01df4b2f2f044989cd6fb5b213f54b1 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__racqgra3eqo2slli95e0v4a8ousp00n1rljid0krqfublc33j7nohuvvskffqf63/family1/b01df4b2f2f044989cd6fb5b213f54b1 2023-11-25 12:54:31,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__racqgra3eqo2slli95e0v4a8ousp00n1rljid0krqfublc33j7nohuvvskffqf63/family1/b01df4b2f2f044989cd6fb5b213f54b1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/f406830fe2dc4e259ea2475f9238e164_SeqId_52_ 2023-11-25 12:54:31,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__racqgra3eqo2slli95e0v4a8ousp00n1rljid0krqfublc33j7nohuvvskffqf63/family1/b01df4b2f2f044989cd6fb5b213f54b1 into e8a9f5a78223694384a6169ce0365c9e/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/f406830fe2dc4e259ea2475f9238e164_SeqId_52_ - updating store file list. 2023-11-25 12:54:31,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/f406830fe2dc4e259ea2475f9238e164_SeqId_52_ into e8a9f5a78223694384a6169ce0365c9e/family1 2023-11-25 12:54:31,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__racqgra3eqo2slli95e0v4a8ousp00n1rljid0krqfublc33j7nohuvvskffqf63/family1/b01df4b2f2f044989cd6fb5b213f54b1 into e8a9f5a78223694384a6169ce0365c9e/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/f406830fe2dc4e259ea2475f9238e164_SeqId_52_) 2023-11-25 12:54:31,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__racqgra3eqo2slli95e0v4a8ousp00n1rljid0krqfublc33j7nohuvvskffqf63/family1/b01df4b2f2f044989cd6fb5b213f54b1 2023-11-25 12:54:31,846 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-25 12:54:31,846 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:31,848 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120ddc8dd887e4343a4a5e9a46334fb3fd7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120ddc8dd887e4343a4a5e9a46334fb3fd7 2023-11-25 12:54:31,849 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112891e1179b50e44cd5abb0b0b09e17cba0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112891e1179b50e44cd5abb0b0b09e17cba0 2023-11-25 12:54:31,849 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-25 12:54:31,849 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-25 12:54:31,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:31,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:31,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:31,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-25 12:54:31,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:31,851 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-25 12:54:31,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 511 msec 2023-11-25 12:54:31,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-25 12:54:31,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:32,325 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-25 12:54:32,326 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-25 12:54:32,326 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-25 12:54:32,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-25 12:54:32,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e8a9f5a78223694384a6169ce0365c9e, REOPEN/MOVE}] 2023-11-25 12:54:32,333 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e8a9f5a78223694384a6169ce0365c9e, REOPEN/MOVE 2023-11-25 12:54:32,334 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e8a9f5a78223694384a6169ce0365c9e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:32,334 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700916872334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916872334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916872334"}]},"ts":"1700916872334"} 2023-11-25 12:54:32,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure e8a9f5a78223694384a6169ce0365c9e, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:32,486 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:32,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:32,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e8a9f5a78223694384a6169ce0365c9e, disabling compactions & flushes 2023-11-25 12:54:32,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:32,570 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/.tmp/family1/a6221cd5683a45ce81e86bc632894e7d as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/a6221cd5683a45ce81e86bc632894e7d 2023-11-25 12:54:32,575 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e8a9f5a78223694384a6169ce0365c9e/family1 of e8a9f5a78223694384a6169ce0365c9e into a6221cd5683a45ce81e86bc632894e7d(size=193.0 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:54:32,575 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:32,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:32,575 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e., storeName=e8a9f5a78223694384a6169ce0365c9e/family1, priority=13, startTime=1700916871323; duration=1sec 2023-11-25 12:54:32,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:32,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. after waiting 0 ms 2023-11-25 12:54:32,575 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:32,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:32,578 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/3c22c28c4fc94f9dbde8c27c50c539ff, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/137501b9db22468f83be26852bb5882a, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/68edacec90554df385675a34d137b206_SeqId_46_] to archive 2023-11-25 12:54:32,579 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:32,580 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/3c22c28c4fc94f9dbde8c27c50c539ff to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/3c22c28c4fc94f9dbde8c27c50c539ff 2023-11-25 12:54:32,582 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/137501b9db22468f83be26852bb5882a to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/137501b9db22468f83be26852bb5882a 2023-11-25 12:54:32,583 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/68edacec90554df385675a34d137b206_SeqId_46_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/68edacec90554df385675a34d137b206_SeqId_46_ 2023-11-25 12:54:32,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-11-25 12:54:32,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:32,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:32,589 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: e8a9f5a78223694384a6169ce0365c9e to self. 2023-11-25 12:54:32,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:32,591 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e8a9f5a78223694384a6169ce0365c9e, regionState=CLOSED 2023-11-25 12:54:32,591 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700916872591"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916872591"}]},"ts":"1700916872591"} 2023-11-25 12:54:32,594 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=52, resume processing ppid=51 2023-11-25 12:54:32,594 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure e8a9f5a78223694384a6169ce0365c9e, server=jenkins-hbase4.apache.org,37051,1700916801082 in 257 msec 2023-11-25 12:54:32,594 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e8a9f5a78223694384a6169ce0365c9e, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=true 2023-11-25 12:54:32,745 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e8a9f5a78223694384a6169ce0365c9e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:32,745 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700916872745"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916872745"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916872745"}]},"ts":"1700916872745"} 2023-11-25 12:54:32,747 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure e8a9f5a78223694384a6169ce0365c9e, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:32,899 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:32,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:32,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e8a9f5a78223694384a6169ce0365c9e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:54:32,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:32,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:32,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:32,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:32,903 INFO [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:32,904 DEBUG [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1 2023-11-25 12:54:32,904 DEBUG [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1 2023-11-25 12:54:32,904 INFO [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8a9f5a78223694384a6169ce0365c9e columnFamilyName family1 2023-11-25 12:54:32,909 DEBUG [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/a6221cd5683a45ce81e86bc632894e7d 2023-11-25 12:54:32,912 DEBUG [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/family1/f406830fe2dc4e259ea2475f9238e164_SeqId_52_ 2023-11-25 12:54:32,912 INFO [StoreOpener-e8a9f5a78223694384a6169ce0365c9e-1] regionserver.HStore(310): Store=e8a9f5a78223694384a6169ce0365c9e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:32,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:32,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:32,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:54:32,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e8a9f5a78223694384a6169ce0365c9e; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68290972, jitterRate=0.017614781856536865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-25 12:54:32,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:54:32,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e., pid=53, masterSystemTime=1700916872899 2023-11-25 12:54:32,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:32,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:54:32,920 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e8a9f5a78223694384a6169ce0365c9e, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:32,920 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700916872920"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916872920"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916872920"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916872920"}]},"ts":"1700916872920"} 2023-11-25 12:54:32,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=53, resume processing ppid=51 2023-11-25 12:54:32,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure e8a9f5a78223694384a6169ce0365c9e, server=jenkins-hbase4.apache.org,37051,1700916801082 in 175 msec 2023-11-25 12:54:32,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=51, resume processing ppid=50 2023-11-25 12:54:32,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e8a9f5a78223694384a6169ce0365c9e, REOPEN/MOVE in 591 msec 2023-11-25 12:54:32,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=50, resume processing ppid=49 2023-11-25 12:54:32,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 597 msec 2023-11-25 12:54:32,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0110 sec 2023-11-25 12:54:32,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-25 12:54:32,929 INFO [Listener at localhost/45289] compactions.TestMobCompactor(278): alter status finished 2023-11-25 12:54:32,930 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38201] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-25 12:54:32,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-25 12:54:32,932 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-25 12:54:32,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:32,933 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700917472933 2023-11-25 12:54:32,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-25 12:54:32,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-25 12:54:32,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-25 12:54:32,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] zookeeper.ReadOnlyZKClient(139): Connect 0x548a4a21 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:54:32,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a9617e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:54:32,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:32,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:32,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:32,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:32,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:32,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:32,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:32,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-25 12:54:32,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-25 12:54:32,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:32,941 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-25 12:54:32,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-11-25 12:54:33,003 INFO [Listener at localhost/45289] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=254 (was 259), OpenFileDescriptor=658 (was 648) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=197 (was 208), ProcessCount=170 (was 170), AvailableMemoryMB=8133 (was 8152) 2023-11-25 12:54:33,016 INFO [Listener at localhost/45289] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=254, OpenFileDescriptor=658, MaxFileDescriptor=60000, SystemLoadAverage=197, ProcessCount=170, AvailableMemoryMB=8132 2023-11-25 12:54:33,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-25 12:54:33,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:33,020 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-25 12:54:33,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-25 12:54:33,021 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-25 12:54:33,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-25 12:54:33,022 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:33,023 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30 empty. 2023-11-25 12:54:33,023 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:33,023 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-25 12:54:33,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-25 12:54:33,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-25 12:54:33,431 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-25 12:54:33,433 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 01cde85952d5e08a35d21599fa528f30, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:54:33,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-25 12:54:33,839 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:33,839 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 01cde85952d5e08a35d21599fa528f30, disabling compactions & flushes 2023-11-25 12:54:33,839 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:33,839 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:33,839 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. after waiting 0 ms 2023-11-25 12:54:33,839 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:33,839 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:33,839 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:33,843 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-25 12:54:33,844 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700916873844"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916873844"}]},"ts":"1700916873844"} 2023-11-25 12:54:33,845 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-25 12:54:33,846 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-25 12:54:33,846 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916873846"}]},"ts":"1700916873846"} 2023-11-25 12:54:33,847 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-25 12:54:33,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=01cde85952d5e08a35d21599fa528f30, ASSIGN}] 2023-11-25 12:54:33,852 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=01cde85952d5e08a35d21599fa528f30, ASSIGN 2023-11-25 12:54:33,852 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=01cde85952d5e08a35d21599fa528f30, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:54:34,004 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=01cde85952d5e08a35d21599fa528f30, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:34,004 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700916874003"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916874003"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916874003"}]},"ts":"1700916874003"} 2023-11-25 12:54:34,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 01cde85952d5e08a35d21599fa528f30, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:34,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-25 12:54:34,157 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:34,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:34,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 01cde85952d5e08a35d21599fa528f30, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:54:34,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:34,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:34,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:34,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:34,162 INFO [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:34,164 DEBUG [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1 2023-11-25 12:54:34,164 DEBUG [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1 2023-11-25 12:54:34,164 INFO [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01cde85952d5e08a35d21599fa528f30 columnFamilyName family1 2023-11-25 12:54:34,165 INFO [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] regionserver.HStore(310): Store=01cde85952d5e08a35d21599fa528f30/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:34,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:34,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:34,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:34,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:54:34,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 01cde85952d5e08a35d21599fa528f30; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62843282, jitterRate=-0.06356212496757507}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-25 12:54:34,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:34,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30., pid=57, masterSystemTime=1700916874157 2023-11-25 12:54:34,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:34,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:34,175 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=01cde85952d5e08a35d21599fa528f30, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:34,175 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700916874175"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916874175"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916874175"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916874175"}]},"ts":"1700916874175"} 2023-11-25 12:54:34,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=57, resume processing ppid=56 2023-11-25 12:54:34,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 01cde85952d5e08a35d21599fa528f30, server=jenkins-hbase4.apache.org,37051,1700916801082 in 171 msec 2023-11-25 12:54:34,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=56, resume processing ppid=55 2023-11-25 12:54:34,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=01cde85952d5e08a35d21599fa528f30, ASSIGN in 328 msec 2023-11-25 12:54:34,179 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-25 12:54:34,180 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916874179"}]},"ts":"1700916874179"} 2023-11-25 12:54:34,180 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-25 12:54:34,185 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-25 12:54:34,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1670 sec 2023-11-25 12:54:35,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-25 12:54:35,127 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-25 12:54:35,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:35,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:35,154 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:35,154 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:35,154 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-25 12:54:35,154 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-25 12:54:35,154 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:35,154 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:35,156 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:35,156 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:35,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:35,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:35,156 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:35,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:35,157 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:35,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:35,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:35,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:35,158 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:35,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:35,158 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-25 12:54:35,158 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:35,158 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-25 12:54:35,158 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:35,158 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:35,158 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:35,158 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. started... 2023-11-25 12:54:35,159 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 01cde85952d5e08a35d21599fa528f30 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-25 12:54:35,571 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:35,583 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511308e2e1a217cbd4f4795c58818ca681c76 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511308e2e1a217cbd4f4795c58818ca681c76 2023-11-25 12:54:35,987 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/1303337439f845a09a9824f3f8c70080 2023-11-25 12:54:35,995 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/1303337439f845a09a9824f3f8c70080 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/1303337439f845a09a9824f3f8c70080 2023-11-25 12:54:35,999 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/1303337439f845a09a9824f3f8c70080, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-25 12:54:36,000 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 01cde85952d5e08a35d21599fa528f30 in 841ms, sequenceid=5, compaction requested=false 2023-11-25 12:54:36,001 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:36,001 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:36,001 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:36,001 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:36,001 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,001 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-25 12:54:36,001 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-25 12:54:36,003 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,003 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:36,003 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,003 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:36,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:36,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-25 12:54:36,005 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-25 12:54:36,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@cd7d1a5[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:36,005 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,006 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,006 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-25 12:54:36,006 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-25 12:54:36,006 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:36,006 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,006 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:36,008 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,008 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-25 12:54:36,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:36,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:36,008 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:36,008 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-25 12:54:36,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:36,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:36,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:36,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:36,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-25 12:54:36,011 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-25 12:54:36,011 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:36,011 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:36,011 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,011 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:36,015 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,015 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,015 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:36,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:36,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:36,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:36,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:36,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:36,016 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:36,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,017 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:36,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,020 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,020 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,020 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,020 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,020 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:36,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:36,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:36,020 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,020 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:36,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-25 12:54:36,020 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,020 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:36,020 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:36,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:36,021 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:36,021 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:36,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:36,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:36,121 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:36,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:36,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:36,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:36,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,127 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:36,127 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:36,128 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-25 12:54:36,128 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-25 12:54:36,128 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,128 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,130 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,130 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:36,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:36,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:36,131 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,131 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:36,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:36,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,132 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,132 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-25 12:54:36,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,132 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-25 12:54:36,132 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:36,132 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-25 12:54:36,132 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:36,132 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:36,132 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:36,132 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. started... 2023-11-25 12:54:36,133 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 01cde85952d5e08a35d21599fa528f30 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-25 12:54:36,543 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-25 12:54:36,546 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d69470dbd33e461298d1ef2a22d97f74 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128d69470dbd33e461298d1ef2a22d97f74 2023-11-25 12:54:36,555 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/46c5a5af40104a3a800b926c729bfbec 2023-11-25 12:54:36,575 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x548a4a21 to 127.0.0.1:63200 2023-11-25 12:54:36,575 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:54:36,575 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:54:36,575 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56c4e327 to 127.0.0.1:63200 2023-11-25 12:54:36,575 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:54:36,575 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:54:36,576 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3015a840 to 127.0.0.1:63200 2023-11-25 12:54:36,576 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:54:36,576 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:54:36,576 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x221b9d21 to 127.0.0.1:63200 2023-11-25 12:54:36,576 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:54:36,576 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:54:36,576 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10049ec5 to 127.0.0.1:63200 2023-11-25 12:54:36,576 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:54:36,582 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/46c5a5af40104a3a800b926c729bfbec as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/46c5a5af40104a3a800b926c729bfbec 2023-11-25 12:54:36,586 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/46c5a5af40104a3a800b926c729bfbec, entries=1, sequenceid=9, filesize=5.0 K 2023-11-25 12:54:36,587 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 01cde85952d5e08a35d21599fa528f30 in 455ms, sequenceid=9, compaction requested=false 2023-11-25 12:54:36,587 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:36,587 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:36,588 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:36,588 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:36,588 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,588 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-25 12:54:36,588 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-25 12:54:36,591 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,591 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:36,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:36,591 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,591 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:36,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:36,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:36,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:36,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-25 12:54:36,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bab856a[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:36,593 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-25 12:54:36,593 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,595 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,595 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-25 12:54:36,595 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-25 12:54:36,595 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:36,595 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,596 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:36,597 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,597 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-25 12:54:36,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:36,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:36,597 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:36,597 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-25 12:54:36,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:36,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:36,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:36,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:36,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-25 12:54:36,600 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-25 12:54:36,600 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:36,600 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:36,600 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,600 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:36,602 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,602 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:36,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:36,602 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:36,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:36,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:36,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:36,603 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:36,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,605 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:36,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,609 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,609 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:36,609 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:36,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:36,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:36,610 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,610 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:36,610 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,610 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:36,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:36,610 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,610 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,610 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:36,610 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:36,610 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:36,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:36,710 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:36,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:36,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:36,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:36,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,716 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:36,717 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:36,717 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-25 12:54:36,717 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-25 12:54:36,717 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,717 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,718 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,718 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:36,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:36,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:36,719 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:36,719 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:36,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:36,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,719 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,720 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-25 12:54:36,720 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:36,720 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-25 12:54:36,720 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:36,720 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-25 12:54:36,720 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:36,720 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:36,720 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:36,720 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. started... 2023-11-25 12:54:36,720 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 01cde85952d5e08a35d21599fa528f30 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:37,132 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512012e2759f719b443f2ad3450b3ce1a082f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512012e2759f719b443f2ad3450b3ce1a082f 2023-11-25 12:54:37,538 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/1a0698dcfb264706993b2aff78bb5e95 2023-11-25 12:54:37,542 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/1a0698dcfb264706993b2aff78bb5e95 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/1a0698dcfb264706993b2aff78bb5e95 2023-11-25 12:54:37,546 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/1a0698dcfb264706993b2aff78bb5e95, entries=1, sequenceid=13, filesize=5.0 K 2023-11-25 12:54:37,547 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 01cde85952d5e08a35d21599fa528f30 in 827ms, sequenceid=13, compaction requested=true 2023-11-25 12:54:37,547 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:37,547 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:37,547 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:37,547 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:37,547 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,547 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-25 12:54:37,547 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-25 12:54:37,549 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,549 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:37,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:37,549 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,549 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:37,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:37,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-25 12:54:37,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38452722[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:37,551 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-25 12:54:37,551 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,552 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,552 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-25 12:54:37,552 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-25 12:54:37,552 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:37,552 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,552 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:37,555 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-25 12:54:37,555 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,555 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:37,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:37,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:37,555 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-25 12:54:37,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:37,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:37,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:37,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:37,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-25 12:54:37,557 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-25 12:54:37,557 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:37,557 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:37,557 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,557 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:37,559 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,559 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:37,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:37,559 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:37,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:37,560 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:37,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,561 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:37,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,566 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,566 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:37,566 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:37,566 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:37,566 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:37,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:37,566 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,566 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:37,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:37,567 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,567 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,567 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,567 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:37,567 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:37,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:37,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:37,667 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:37,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:37,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:37,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:37,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,674 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:37,674 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:37,674 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-25 12:54:37,674 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-25 12:54:37,674 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,674 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,681 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:37,681 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:37,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:37,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,681 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:37,681 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:37,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:37,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,682 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,682 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-25 12:54:37,682 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:37,682 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-25 12:54:37,682 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:37,682 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-25 12:54:37,682 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:37,682 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:37,683 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:37,683 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. started... 2023-11-25 12:54:37,683 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 01cde85952d5e08a35d21599fa528f30 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:38,095 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205838d7b05bf0e44608bff566b3ea6a6ee to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205838d7b05bf0e44608bff566b3ea6a6ee 2023-11-25 12:54:38,101 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/f5a3f6a910e6494399910e9a5cf8752d 2023-11-25 12:54:38,106 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/f5a3f6a910e6494399910e9a5cf8752d as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f5a3f6a910e6494399910e9a5cf8752d 2023-11-25 12:54:38,110 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f5a3f6a910e6494399910e9a5cf8752d, entries=1, sequenceid=17, filesize=5.0 K 2023-11-25 12:54:38,111 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 01cde85952d5e08a35d21599fa528f30 in 428ms, sequenceid=17, compaction requested=true 2023-11-25 12:54:38,111 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:38,111 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:38,111 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:38,111 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:38,111 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,111 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-25 12:54:38,111 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-25 12:54:38,113 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,113 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:38,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:38,113 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,113 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:38,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:38,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:38,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:38,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-25 12:54:38,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b77653[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:38,115 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-25 12:54:38,115 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,116 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,116 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-25 12:54:38,116 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-25 12:54:38,116 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,116 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:38,116 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:38,118 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-25 12:54:38,118 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,118 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:38,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:38,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:38,118 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-25 12:54:38,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:38,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:38,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:38,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:38,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-25 12:54:38,121 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-25 12:54:38,121 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:38,121 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:38,121 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,121 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:38,123 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,123 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:38,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:38,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,123 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:38,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:38,123 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:38,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:38,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:38,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,125 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:38,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,127 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,127 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,127 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,127 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,127 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:38,127 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:38,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:38,127 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:38,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:38,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:38,127 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:38,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-25 12:54:38,127 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,127 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:38,127 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,127 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:38,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:38,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:38,228 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:38,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:38,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:38,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:38,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,234 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:38,234 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:38,234 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-25 12:54:38,234 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-25 12:54:38,235 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,235 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,236 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,236 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:38,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:38,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:38,237 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:38,237 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:38,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:38,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,237 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,238 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-25 12:54:38,238 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:38,238 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-25 12:54:38,238 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:38,238 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-25 12:54:38,238 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:38,238 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:38,238 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:38,238 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. started... 2023-11-25 12:54:38,238 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 01cde85952d5e08a35d21599fa528f30 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:38,651 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228863c9c1c3e9d4e65874f2e49d580df60 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228863c9c1c3e9d4e65874f2e49d580df60 2023-11-25 12:54:39,057 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/0896a94476b44f38bc38119e16923ea2 2023-11-25 12:54:39,063 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/0896a94476b44f38bc38119e16923ea2 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/0896a94476b44f38bc38119e16923ea2 2023-11-25 12:54:39,067 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/0896a94476b44f38bc38119e16923ea2, entries=1, sequenceid=21, filesize=5.0 K 2023-11-25 12:54:39,068 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 01cde85952d5e08a35d21599fa528f30 in 830ms, sequenceid=21, compaction requested=true 2023-11-25 12:54:39,068 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:39,068 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:39,068 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:39,068 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:39,068 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,068 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-25 12:54:39,069 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-25 12:54:39,071 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,071 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:39,071 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,071 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:39,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-25 12:54:39,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32dfd519[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:39,073 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-25 12:54:39,073 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,074 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,074 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-25 12:54:39,074 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-25 12:54:39,074 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:39,074 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,074 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:39,075 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,075 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-25 12:54:39,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:39,076 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:39,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:39,076 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-25 12:54:39,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:39,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:39,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-25 12:54:39,078 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-25 12:54:39,078 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:39,078 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:39,079 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,079 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:39,080 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,080 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:39,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,080 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:39,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,081 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,082 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:39,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,086 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:39,086 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,086 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:39,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:39,086 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:39,086 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:39,086 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:39,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:39,086 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,086 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,086 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,086 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:39,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:39,087 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:39,087 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:39,187 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:39,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:39,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:39,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:39,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,193 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:39,193 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:39,193 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-25 12:54:39,193 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-25 12:54:39,193 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,193 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,195 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,195 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:39,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:39,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:39,195 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:39,195 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:39,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:39,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,196 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,196 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-25 12:54:39,196 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:39,196 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-25 12:54:39,196 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:39,196 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-25 12:54:39,197 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:39,197 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:39,197 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:39,197 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. started... 2023-11-25 12:54:39,197 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 01cde85952d5e08a35d21599fa528f30 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:39,609 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314686f06d342f45898951d82f6cc7da57 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512314686f06d342f45898951d82f6cc7da57 2023-11-25 12:54:40,016 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/e5f1ebb0f8604ff9bc0e4af133df94c8 2023-11-25 12:54:40,020 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/e5f1ebb0f8604ff9bc0e4af133df94c8 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/e5f1ebb0f8604ff9bc0e4af133df94c8 2023-11-25 12:54:40,024 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/e5f1ebb0f8604ff9bc0e4af133df94c8, entries=1, sequenceid=25, filesize=5.0 K 2023-11-25 12:54:40,025 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 01cde85952d5e08a35d21599fa528f30 in 828ms, sequenceid=25, compaction requested=true 2023-11-25 12:54:40,025 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:40,025 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:40,025 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:40,025 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:40,025 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,025 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-25 12:54:40,025 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-25 12:54:40,027 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,027 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:40,027 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,027 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:40,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:40,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:40,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-25 12:54:40,029 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-25 12:54:40,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@658886fd[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:40,029 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,031 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,031 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-25 12:54:40,032 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-25 12:54:40,032 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:40,032 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,032 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:40,033 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-25 12:54:40,033 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,033 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:40,033 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-25 12:54:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:40,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:40,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-25 12:54:40,036 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-25 12:54:40,036 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:40,036 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:40,036 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,036 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:40,037 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,037 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:40,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,037 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:40,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:40,038 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,039 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,042 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,042 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,042 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,042 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:40,042 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,042 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:40,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:40,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:40,042 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:40,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-25 12:54:40,042 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:40,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:40,042 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,042 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:40,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:40,043 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:40,043 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:40,143 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:40,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:40,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:40,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:40,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,149 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:40,149 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:40,149 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-25 12:54:40,149 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-25 12:54:40,149 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,149 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,152 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,152 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:40,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:40,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:40,152 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,152 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:40,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:40,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,153 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,153 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-25 12:54:40,153 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,154 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-25 12:54:40,154 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:40,154 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-25 12:54:40,154 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:40,154 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:40,154 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:40,154 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. started... 2023-11-25 12:54:40,154 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 01cde85952d5e08a35d21599fa528f30 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:40,567 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601010080f6aedbce4cea83b3f2f774412878 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601010080f6aedbce4cea83b3f2f774412878 2023-11-25 12:54:40,973 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/7a782c89e2e14143b4d934d9174e36ad 2023-11-25 12:54:40,978 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/7a782c89e2e14143b4d934d9174e36ad as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/7a782c89e2e14143b4d934d9174e36ad 2023-11-25 12:54:40,982 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/7a782c89e2e14143b4d934d9174e36ad, entries=1, sequenceid=29, filesize=5.0 K 2023-11-25 12:54:40,982 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 01cde85952d5e08a35d21599fa528f30 in 828ms, sequenceid=29, compaction requested=true 2023-11-25 12:54:40,982 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:40,983 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:40,983 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:40,983 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:40,983 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,983 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-25 12:54:40,983 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-25 12:54:40,985 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,985 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:40,985 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,985 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:40,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:40,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-25 12:54:40,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7465d159[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:40,986 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-25 12:54:40,986 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,988 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,988 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-25 12:54:40,988 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-25 12:54:40,988 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:40,988 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,988 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:40,989 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-25 12:54:40,989 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,989 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:40,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:40,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:40,989 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-25 12:54:40,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:40,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:40,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:40,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:40,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-25 12:54:40,992 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-25 12:54:40,992 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:40,992 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:40,992 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,992 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:40,995 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,995 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,995 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:40,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:40,995 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:40,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,997 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:40,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,999 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,999 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,999 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,999 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:40,999 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:40,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:40,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:40,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:40,999 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:40,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:40,999 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:40,999 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,999 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,999 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:40,999 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:40,999 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:40,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:40,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:41,099 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:41,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:41,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:41,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:41,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,107 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:41,107 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:41,107 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-25 12:54:41,107 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-25 12:54:41,107 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,107 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,109 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,109 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:41,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:41,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:41,109 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,109 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:41,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:41,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,110 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,110 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-25 12:54:41,110 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,110 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-25 12:54:41,111 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:41,111 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-25 12:54:41,112 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:41,112 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:41,112 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:41,112 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. started... 2023-11-25 12:54:41,112 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 01cde85952d5e08a35d21599fa528f30 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:41,533 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036cae3a7cc29e4e68bef02af158d6f7d6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601036cae3a7cc29e4e68bef02af158d6f7d6 2023-11-25 12:54:41,938 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/9932cda9a3104016b9db702c99961251 2023-11-25 12:54:41,943 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/9932cda9a3104016b9db702c99961251 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/9932cda9a3104016b9db702c99961251 2023-11-25 12:54:41,947 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/9932cda9a3104016b9db702c99961251, entries=1, sequenceid=33, filesize=5.0 K 2023-11-25 12:54:41,948 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 01cde85952d5e08a35d21599fa528f30 in 836ms, sequenceid=33, compaction requested=true 2023-11-25 12:54:41,948 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:41,948 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:41,948 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:41,948 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:41,948 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,948 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-25 12:54:41,948 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-25 12:54:41,950 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,950 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:41,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:41,950 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,950 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:41,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:41,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:41,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:41,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-25 12:54:41,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fdb3468[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:41,952 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-25 12:54:41,952 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,957 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,957 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-25 12:54:41,957 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-25 12:54:41,957 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:41,957 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,957 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:41,958 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-25 12:54:41,958 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:41,958 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,958 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-25 12:54:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:41,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:41,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:41,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:41,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:41,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-25 12:54:41,961 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-25 12:54:41,961 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:41,961 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:41,961 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,961 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:41,963 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,963 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,963 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:41,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:41,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:41,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:41,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:41,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:41,963 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,965 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,968 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,968 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,968 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:41,968 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:41,968 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:41,968 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:41,968 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:41,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:41,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:41,968 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:41,968 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,968 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:41,968 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:41,969 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:41,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:42,069 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:42,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:42,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:42,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:42,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,075 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:42,075 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:42,075 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-25 12:54:42,075 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-25 12:54:42,076 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,076 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,077 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:42,077 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:42,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:42,078 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,078 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:42,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:42,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,079 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-25 12:54:42,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,079 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-25 12:54:42,079 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:42,079 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-25 12:54:42,079 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:42,079 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:42,079 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:42,079 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. started... 2023-11-25 12:54:42,079 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 01cde85952d5e08a35d21599fa528f30 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:42,093 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a7134db7dd39488b904cfdc85826c1a7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907a7134db7dd39488b904cfdc85826c1a7 2023-11-25 12:54:42,500 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/fbbb397c938548f982c209cd59836e87 2023-11-25 12:54:42,504 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/fbbb397c938548f982c209cd59836e87 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/fbbb397c938548f982c209cd59836e87 2023-11-25 12:54:42,508 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/fbbb397c938548f982c209cd59836e87, entries=1, sequenceid=37, filesize=5.0 K 2023-11-25 12:54:42,509 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 01cde85952d5e08a35d21599fa528f30 in 430ms, sequenceid=37, compaction requested=true 2023-11-25 12:54:42,509 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:42,509 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:42,509 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:42,509 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:42,509 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,509 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-25 12:54:42,509 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-25 12:54:42,511 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,511 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:42,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:42,512 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:42,512 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:42,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:42,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:42,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-25 12:54:42,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3604797[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:42,513 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-25 12:54:42,513 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,514 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,514 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-25 12:54:42,515 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-25 12:54:42,515 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:42,515 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,515 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:42,517 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-25 12:54:42,517 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,517 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:42,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:42,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:42,517 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-25 12:54:42,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:42,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:42,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:42,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:42,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-25 12:54:42,519 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-25 12:54:42,520 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:42,520 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:42,520 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,520 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:42,521 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:42,521 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,521 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:42,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:42,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:42,522 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,523 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:42,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,525 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,525 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,525 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,525 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,525 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,525 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,526 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:42,526 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:42,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:42,526 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:42,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-25 12:54:42,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:42,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:42,526 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:42,526 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:42,526 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:42,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:42,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:42,626 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:42,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:42,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:42,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:42,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,633 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:42,633 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:42,633 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-25 12:54:42,633 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-25 12:54:42,634 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,634 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,635 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,635 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:42,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:42,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:42,635 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:42,635 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:42,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,636 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:42,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,636 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,636 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-25 12:54:42,636 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:42,636 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-25 12:54:42,637 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:42,637 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-25 12:54:42,637 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:54:42,637 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:42,637 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:42,637 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. started... 2023-11-25 12:54:42,637 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 01cde85952d5e08a35d21599fa528f30 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:54:43,050 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120f89cc0d538ca46019ad3c9c09a3a7b4c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120f89cc0d538ca46019ad3c9c09a3a7b4c 2023-11-25 12:54:43,456 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/f8dfc661416f4d4ebc49ae769f64e1f9 2023-11-25 12:54:43,460 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/f8dfc661416f4d4ebc49ae769f64e1f9 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f8dfc661416f4d4ebc49ae769f64e1f9 2023-11-25 12:54:43,463 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f8dfc661416f4d4ebc49ae769f64e1f9, entries=1, sequenceid=41, filesize=5.0 K 2023-11-25 12:54:43,464 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 01cde85952d5e08a35d21599fa528f30 in 827ms, sequenceid=41, compaction requested=true 2023-11-25 12:54:43,464 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:43,464 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:43,464 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:54:43,464 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:54:43,464 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:43,464 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-25 12:54:43,465 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-25 12:54:43,467 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,467 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:43,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:43,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:43,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:43,467 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,467 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:43,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:43,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:43,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:43,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:43,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-25 12:54:43,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@227e9668[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:43,469 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-25 12:54:43,469 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,470 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,470 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-25 12:54:43,470 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-25 12:54:43,470 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:43,470 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:43,471 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:43,472 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:43,472 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-25 12:54:43,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:43,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:43,472 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:43,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:43,472 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-25 12:54:43,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:43,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:43,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:43,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:43,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:43,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:43,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-25 12:54:43,474 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-25 12:54:43,474 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:43,474 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:43,474 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,474 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:43,479 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,479 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:43,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:43,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,479 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:43,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:43,480 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:43,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:43,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:43,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:43,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:43,481 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:43,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:43,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:43,484 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:43,484 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,484 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,484 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:43,485 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:43,485 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:43,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:43,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:43,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-25 12:54:43,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:43,485 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:43,485 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-25 12:54:43,485 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,485 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:43,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:43,485 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:43,485 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:43,585 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:43,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:43,588 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38201] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:43,589 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-25 12:54:43,590 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-25 12:54:43,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:43,590 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700917483590 2023-11-25 12:54:43,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-25 12:54:43,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-25 12:54:43,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-25 12:54:43,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] zookeeper.ReadOnlyZKClient(139): Connect 0x4f650c61 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:54:43,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10740725, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:54:43,599 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:44,037 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ed135f8841224ebe8cda5024a41f3a62 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103ed135f8841224ebe8cda5024a41f3a62 2023-11-25 12:54:44,038 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-25 12:54:44,053 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:54:44,054 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:54:44,062 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:54:44,063 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:54:44,072 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/062783717bce4a648a8444db608650c6 first=Optional[r3] last=Optional[r6] 2023-11-25 12:54:44,072 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/062783717bce4a648a8444db608650c6}] 2023-11-25 12:54:44,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/062783717bce4a648a8444db608650c6 for inclusion in 01cde85952d5e08a35d21599fa528f30/family1 2023-11-25 12:54:44,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-25 12:54:44,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:54:44,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:44,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/062783717bce4a648a8444db608650c6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__44q7ojfbhg980882j2frtt17s8saq0p9l3dnq951vs8491gtlnovu93eap3jckvi/family1/062783717bce4a648a8444db608650c6 2023-11-25 12:54:44,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__44q7ojfbhg980882j2frtt17s8saq0p9l3dnq951vs8491gtlnovu93eap3jckvi/family1/062783717bce4a648a8444db608650c6 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/98572959319949d9bf7b4715dad4cf97_SeqId_44_ 2023-11-25 12:54:44,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__44q7ojfbhg980882j2frtt17s8saq0p9l3dnq951vs8491gtlnovu93eap3jckvi/family1/062783717bce4a648a8444db608650c6 into 01cde85952d5e08a35d21599fa528f30/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/98572959319949d9bf7b4715dad4cf97_SeqId_44_ - updating store file list. 2023-11-25 12:54:44,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/98572959319949d9bf7b4715dad4cf97_SeqId_44_ into 01cde85952d5e08a35d21599fa528f30/family1 2023-11-25 12:54:44,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__44q7ojfbhg980882j2frtt17s8saq0p9l3dnq951vs8491gtlnovu93eap3jckvi/family1/062783717bce4a648a8444db608650c6 into 01cde85952d5e08a35d21599fa528f30/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/98572959319949d9bf7b4715dad4cf97_SeqId_44_) 2023-11-25 12:54:44,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__44q7ojfbhg980882j2frtt17s8saq0p9l3dnq951vs8491gtlnovu93eap3jckvi/family1/062783717bce4a648a8444db608650c6 2023-11-25 12:54:44,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-25 12:54:44,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-25 12:54:44,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(1912): 01cde85952d5e08a35d21599fa528f30/family1 is initiating minor compaction 2023-11-25 12:54:44,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4fe4b7c9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:44,092 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 01cde85952d5e08a35d21599fa528f30/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:44,093 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/46c5a5af40104a3a800b926c729bfbec, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/1a0698dcfb264706993b2aff78bb5e95, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f5a3f6a910e6494399910e9a5cf8752d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/0896a94476b44f38bc38119e16923ea2, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/e5f1ebb0f8604ff9bc0e4af133df94c8, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/7a782c89e2e14143b4d934d9174e36ad, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/9932cda9a3104016b9db702c99961251, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/fbbb397c938548f982c209cd59836e87, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f8dfc661416f4d4ebc49ae769f64e1f9, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/98572959319949d9bf7b4715dad4cf97_SeqId_44_] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp, totalSize=50.3 K 2023-11-25 12:54:44,093 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 46c5a5af40104a3a800b926c729bfbec, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-25 12:54:44,093 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 1a0698dcfb264706993b2aff78bb5e95, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-25 12:54:44,093 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting f5a3f6a910e6494399910e9a5cf8752d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-25 12:54:44,093 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 0896a94476b44f38bc38119e16923ea2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-25 12:54:44,093 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting e5f1ebb0f8604ff9bc0e4af133df94c8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-25 12:54:44,093 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 7a782c89e2e14143b4d934d9174e36ad, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-25 12:54:44,093 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 9932cda9a3104016b9db702c99961251, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-25 12:54:44,093 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting fbbb397c938548f982c209cd59836e87, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-25 12:54:44,093 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting f8dfc661416f4d4ebc49ae769f64e1f9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-25 12:54:44,093 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 98572959319949d9bf7b4715dad4cf97_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-25 12:54:44,095 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-25 12:54:44,096 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:44,098 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228863c9c1c3e9d4e65874f2e49d580df60 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228863c9c1c3e9d4e65874f2e49d580df60 2023-11-25 12:54:44,099 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512314686f06d342f45898951d82f6cc7da57 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512314686f06d342f45898951d82f6cc7da57 2023-11-25 12:54:44,101 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601010080f6aedbce4cea83b3f2f774412878 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601010080f6aedbce4cea83b3f2f774412878 2023-11-25 12:54:44,102 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601036cae3a7cc29e4e68bef02af158d6f7d6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601036cae3a7cc29e4e68bef02af158d6f7d6 2023-11-25 12:54:44,102 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-25 12:54:44,102 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-25 12:54:44,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:44,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:44,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:44,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:44,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:44,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:44,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:44,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:44,132 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 01cde85952d5e08a35d21599fa528f30#family1#compaction#71 average throughput is 0.40 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-25 12:54:44,161 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120507b0af6ec32040f3ace0231a86b727eb to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120507b0af6ec32040f3ace0231a86b727eb 2023-11-25 12:54:44,162 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-25 12:54:44,185 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f2e0d9d886244439a1487d9e589a4214 first=Optional[r00] last=Optional[r2] 2023-11-25 12:54:44,186 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f2e0d9d886244439a1487d9e589a4214}] 2023-11-25 12:54:44,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f2e0d9d886244439a1487d9e589a4214 for inclusion in 01cde85952d5e08a35d21599fa528f30/family1 2023-11-25 12:54:44,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-25 12:54:44,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:54:44,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:44,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f2e0d9d886244439a1487d9e589a4214 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9rms8fhamf7cnvjuq9vkbjveaap9s6ebj661kvtterd2s535dpvtt7nn5t7tlj79/family1/f2e0d9d886244439a1487d9e589a4214 2023-11-25 12:54:44,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9rms8fhamf7cnvjuq9vkbjveaap9s6ebj661kvtterd2s535dpvtt7nn5t7tlj79/family1/f2e0d9d886244439a1487d9e589a4214 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/edcff3c591894cab8e181af18bebb675_SeqId_46_ 2023-11-25 12:54:44,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9rms8fhamf7cnvjuq9vkbjveaap9s6ebj661kvtterd2s535dpvtt7nn5t7tlj79/family1/f2e0d9d886244439a1487d9e589a4214 into 01cde85952d5e08a35d21599fa528f30/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/edcff3c591894cab8e181af18bebb675_SeqId_46_ - updating store file list. 2023-11-25 12:54:44,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/edcff3c591894cab8e181af18bebb675_SeqId_46_ into 01cde85952d5e08a35d21599fa528f30/family1 2023-11-25 12:54:44,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9rms8fhamf7cnvjuq9vkbjveaap9s6ebj661kvtterd2s535dpvtt7nn5t7tlj79/family1/f2e0d9d886244439a1487d9e589a4214 into 01cde85952d5e08a35d21599fa528f30/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/edcff3c591894cab8e181af18bebb675_SeqId_46_) 2023-11-25 12:54:44,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9rms8fhamf7cnvjuq9vkbjveaap9s6ebj661kvtterd2s535dpvtt7nn5t7tlj79/family1/f2e0d9d886244439a1487d9e589a4214 2023-11-25 12:54:44,202 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-25 12:54:44,202 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:44,204 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511308e2e1a217cbd4f4795c58818ca681c76 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511308e2e1a217cbd4f4795c58818ca681c76 2023-11-25 12:54:44,205 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512012e2759f719b443f2ad3450b3ce1a082f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512012e2759f719b443f2ad3450b3ce1a082f 2023-11-25 12:54:44,206 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205838d7b05bf0e44608bff566b3ea6a6ee to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205838d7b05bf0e44608bff566b3ea6a6ee 2023-11-25 12:54:44,206 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-25 12:54:44,206 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-25 12:54:44,207 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:44,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-25 12:54:44,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:44,208 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-25 12:54:44,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 620 msec 2023-11-25 12:54:44,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-25 12:54:44,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:44,700 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-25 12:54:44,701 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-25 12:54:44,702 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-25 12:54:44,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-25 12:54:44,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=01cde85952d5e08a35d21599fa528f30, REOPEN/MOVE}] 2023-11-25 12:54:44,706 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=01cde85952d5e08a35d21599fa528f30, REOPEN/MOVE 2023-11-25 12:54:44,707 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=01cde85952d5e08a35d21599fa528f30, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:44,707 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700916884707"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916884707"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916884707"}]},"ts":"1700916884707"} 2023-11-25 12:54:44,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 01cde85952d5e08a35d21599fa528f30, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:44,860 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:44,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:44,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 01cde85952d5e08a35d21599fa528f30, disabling compactions & flushes 2023-11-25 12:54:44,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:44,950 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/9daf71622f024c0d8339479353f169eb as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/9daf71622f024c0d8339479353f169eb 2023-11-25 12:54:44,955 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 01cde85952d5e08a35d21599fa528f30/family1 of 01cde85952d5e08a35d21599fa528f30 into 9daf71622f024c0d8339479353f169eb(size=6.8 K), total size for store is 388.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:54:44,955 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:44,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:44,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:44,955 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700916884092; duration=0sec 2023-11-25 12:54:44,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. after waiting 0 ms 2023-11-25 12:54:44,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:44,955 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:44,963 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/46c5a5af40104a3a800b926c729bfbec, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/1a0698dcfb264706993b2aff78bb5e95, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f5a3f6a910e6494399910e9a5cf8752d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/0896a94476b44f38bc38119e16923ea2, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/e5f1ebb0f8604ff9bc0e4af133df94c8, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/7a782c89e2e14143b4d934d9174e36ad, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/9932cda9a3104016b9db702c99961251, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/fbbb397c938548f982c209cd59836e87, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f8dfc661416f4d4ebc49ae769f64e1f9, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/98572959319949d9bf7b4715dad4cf97_SeqId_44_] to archive 2023-11-25 12:54:44,963 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:44,965 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/46c5a5af40104a3a800b926c729bfbec to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/46c5a5af40104a3a800b926c729bfbec 2023-11-25 12:54:44,966 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/1a0698dcfb264706993b2aff78bb5e95 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/1a0698dcfb264706993b2aff78bb5e95 2023-11-25 12:54:44,967 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f5a3f6a910e6494399910e9a5cf8752d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f5a3f6a910e6494399910e9a5cf8752d 2023-11-25 12:54:44,969 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/0896a94476b44f38bc38119e16923ea2 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/0896a94476b44f38bc38119e16923ea2 2023-11-25 12:54:44,970 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/e5f1ebb0f8604ff9bc0e4af133df94c8 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/e5f1ebb0f8604ff9bc0e4af133df94c8 2023-11-25 12:54:44,971 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/7a782c89e2e14143b4d934d9174e36ad to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/7a782c89e2e14143b4d934d9174e36ad 2023-11-25 12:54:44,972 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/9932cda9a3104016b9db702c99961251 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/9932cda9a3104016b9db702c99961251 2023-11-25 12:54:44,973 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/fbbb397c938548f982c209cd59836e87 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/fbbb397c938548f982c209cd59836e87 2023-11-25 12:54:44,975 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f8dfc661416f4d4ebc49ae769f64e1f9 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f8dfc661416f4d4ebc49ae769f64e1f9 2023-11-25 12:54:44,976 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/98572959319949d9bf7b4715dad4cf97_SeqId_44_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/98572959319949d9bf7b4715dad4cf97_SeqId_44_ 2023-11-25 12:54:44,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-25 12:54:44,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:44,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:44,986 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: 01cde85952d5e08a35d21599fa528f30 to self. 2023-11-25 12:54:44,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:44,988 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=01cde85952d5e08a35d21599fa528f30, regionState=CLOSED 2023-11-25 12:54:44,988 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700916884988"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916884988"}]},"ts":"1700916884988"} 2023-11-25 12:54:44,990 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=62, resume processing ppid=61 2023-11-25 12:54:44,991 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=01cde85952d5e08a35d21599fa528f30, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=true 2023-11-25 12:54:44,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 01cde85952d5e08a35d21599fa528f30, server=jenkins-hbase4.apache.org,37051,1700916801082 in 281 msec 2023-11-25 12:54:45,141 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=01cde85952d5e08a35d21599fa528f30, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:45,142 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700916885141"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916885141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916885141"}]},"ts":"1700916885141"} 2023-11-25 12:54:45,143 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 01cde85952d5e08a35d21599fa528f30, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:45,295 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:45,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:45,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 01cde85952d5e08a35d21599fa528f30, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:54:45,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:45,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:45,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:45,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:45,301 INFO [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:45,302 DEBUG [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1 2023-11-25 12:54:45,302 DEBUG [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1 2023-11-25 12:54:45,302 INFO [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01cde85952d5e08a35d21599fa528f30 columnFamilyName family1 2023-11-25 12:54:45,308 DEBUG [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/1303337439f845a09a9824f3f8c70080 2023-11-25 12:54:45,313 DEBUG [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/9daf71622f024c0d8339479353f169eb 2023-11-25 12:54:45,317 DEBUG [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/edcff3c591894cab8e181af18bebb675_SeqId_46_ 2023-11-25 12:54:45,317 INFO [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] regionserver.HStore(310): Store=01cde85952d5e08a35d21599fa528f30/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:45,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:45,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:45,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:45,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 01cde85952d5e08a35d21599fa528f30; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72505237, jitterRate=0.08041222393512726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-25 12:54:45,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:45,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30., pid=63, masterSystemTime=1700916885295 2023-11-25 12:54:45,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:45,323 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-25 12:54:45,324 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-25 12:54:45,324 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1912): 01cde85952d5e08a35d21599fa528f30/family1 is initiating minor compaction (all files) 2023-11-25 12:54:45,325 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 01cde85952d5e08a35d21599fa528f30/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:45,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:45,325 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/1303337439f845a09a9824f3f8c70080, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/9daf71622f024c0d8339479353f169eb, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/edcff3c591894cab8e181af18bebb675_SeqId_46_] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp, totalSize=388.1 K 2023-11-25 12:54:45,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:45,325 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 1303337439f845a09a9824f3f8c70080, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878825182 2023-11-25 12:54:45,325 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=01cde85952d5e08a35d21599fa528f30, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:45,325 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700916885325"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916885325"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916885325"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916885325"}]},"ts":"1700916885325"} 2023-11-25 12:54:45,325 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 9daf71622f024c0d8339479353f169eb, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621225182 2023-11-25 12:54:45,326 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting edcff3c591894cab8e181af18bebb675_SeqId_46_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878825182 2023-11-25 12:54:45,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=63, resume processing ppid=61 2023-11-25 12:54:45,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 01cde85952d5e08a35d21599fa528f30, server=jenkins-hbase4.apache.org,37051,1700916801082 in 183 msec 2023-11-25 12:54:45,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=61, resume processing ppid=60 2023-11-25 12:54:45,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=01cde85952d5e08a35d21599fa528f30, REOPEN/MOVE in 622 msec 2023-11-25 12:54:45,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=60, resume processing ppid=59 2023-11-25 12:54:45,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 627 msec 2023-11-25 12:54:45,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0420 sec 2023-11-25 12:54:45,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-25 12:54:45,335 INFO [Listener at localhost/45289] compactions.TestMobCompactor(278): alter status finished 2023-11-25 12:54:45,336 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38201] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:45,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-25 12:54:45,338 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-25 12:54:45,339 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700917485339 2023-11-25 12:54:45,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:45,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-25 12:54:45,340 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 01cde85952d5e08a35d21599fa528f30#family1#compaction#72 average throughput is 22.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-25 12:54:45,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-25 12:54:45,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-25 12:54:45,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] zookeeper.ReadOnlyZKClient(139): Connect 0x1deaddbb to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:54:45,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20dde34b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:54:45,354 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:45,354 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:45,354 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:45,354 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:45,354 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:45,777 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283006780feba34faa94b1c53635b47efb to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511283006780feba34faa94b1c53635b47efb 2023-11-25 12:54:45,778 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-25 12:54:45,791 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:54:45,792 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:54:45,799 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:54:45,801 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:54:45,809 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4344fe9b35b0430a9b8cfa24190d895f first=Optional[r05] last=Optional[r8] 2023-11-25 12:54:45,809 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=50 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4344fe9b35b0430a9b8cfa24190d895f}] 2023-11-25 12:54:45,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4344fe9b35b0430a9b8cfa24190d895f for inclusion in 01cde85952d5e08a35d21599fa528f30/family1 2023-11-25 12:54:45,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-25 12:54:45,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:54:45,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:45,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4344fe9b35b0430a9b8cfa24190d895f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tajg6su0q3hcq64inqv4c5nj164k4c0km92sbdfd54qj6jp1ialej1t9s8g2h9so/family1/4344fe9b35b0430a9b8cfa24190d895f 2023-11-25 12:54:45,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tajg6su0q3hcq64inqv4c5nj164k4c0km92sbdfd54qj6jp1ialej1t9s8g2h9so/family1/4344fe9b35b0430a9b8cfa24190d895f as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f499e74f69f34e018d6f0ef1ffa6a128_SeqId_52_ 2023-11-25 12:54:45,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tajg6su0q3hcq64inqv4c5nj164k4c0km92sbdfd54qj6jp1ialej1t9s8g2h9so/family1/4344fe9b35b0430a9b8cfa24190d895f into 01cde85952d5e08a35d21599fa528f30/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f499e74f69f34e018d6f0ef1ffa6a128_SeqId_52_ - updating store file list. 2023-11-25 12:54:45,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f499e74f69f34e018d6f0ef1ffa6a128_SeqId_52_ into 01cde85952d5e08a35d21599fa528f30/family1 2023-11-25 12:54:45,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tajg6su0q3hcq64inqv4c5nj164k4c0km92sbdfd54qj6jp1ialej1t9s8g2h9so/family1/4344fe9b35b0430a9b8cfa24190d895f into 01cde85952d5e08a35d21599fa528f30/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f499e74f69f34e018d6f0ef1ffa6a128_SeqId_52_) 2023-11-25 12:54:45,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tajg6su0q3hcq64inqv4c5nj164k4c0km92sbdfd54qj6jp1ialej1t9s8g2h9so/family1/4344fe9b35b0430a9b8cfa24190d895f 2023-11-25 12:54:45,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-25 12:54:45,826 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:45,828 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120f89cc0d538ca46019ad3c9c09a3a7b4c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120f89cc0d538ca46019ad3c9c09a3a7b4c 2023-11-25 12:54:45,829 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128d69470dbd33e461298d1ef2a22d97f74 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128d69470dbd33e461298d1ef2a22d97f74 2023-11-25 12:54:45,829 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-25 12:54:45,829 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-25 12:54:45,829 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:45,829 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:45,829 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:45,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-25 12:54:45,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:45,830 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-25 12:54:45,831 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 493 msec 2023-11-25 12:54:45,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-25 12:54:45,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:46,165 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/.tmp/family1/bbafb68072c143a4908efcd9de6c6363 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/bbafb68072c143a4908efcd9de6c6363 2023-11-25 12:54:46,170 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 01cde85952d5e08a35d21599fa528f30/family1 of 01cde85952d5e08a35d21599fa528f30 into bbafb68072c143a4908efcd9de6c6363(size=192.0 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:54:46,170 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:46,170 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30., storeName=01cde85952d5e08a35d21599fa528f30/family1, priority=13, startTime=1700916885323; duration=0sec 2023-11-25 12:54:46,170 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:46,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/1303337439f845a09a9824f3f8c70080, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/9daf71622f024c0d8339479353f169eb, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/edcff3c591894cab8e181af18bebb675_SeqId_46_] to archive 2023-11-25 12:54:46,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:46,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/1303337439f845a09a9824f3f8c70080 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/1303337439f845a09a9824f3f8c70080 2023-11-25 12:54:46,259 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/9daf71622f024c0d8339479353f169eb to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/9daf71622f024c0d8339479353f169eb 2023-11-25 12:54:46,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/edcff3c591894cab8e181af18bebb675_SeqId_46_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/edcff3c591894cab8e181af18bebb675_SeqId_46_ 2023-11-25 12:54:46,305 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-25 12:54:46,306 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-25 12:54:46,306 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-25 12:54:46,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-25 12:54:46,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=01cde85952d5e08a35d21599fa528f30, REOPEN/MOVE}] 2023-11-25 12:54:46,310 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=01cde85952d5e08a35d21599fa528f30, REOPEN/MOVE 2023-11-25 12:54:46,311 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=01cde85952d5e08a35d21599fa528f30, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:46,311 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700916886311"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916886311"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916886311"}]},"ts":"1700916886311"} 2023-11-25 12:54:46,312 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 01cde85952d5e08a35d21599fa528f30, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:46,463 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:46,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:46,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 01cde85952d5e08a35d21599fa528f30, disabling compactions & flushes 2023-11-25 12:54:46,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:46,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:46,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. after waiting 0 ms 2023-11-25 12:54:46,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:46,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-11-25 12:54:46,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:46,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:46,469 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: 01cde85952d5e08a35d21599fa528f30 to self. 2023-11-25 12:54:46,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:46,470 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=01cde85952d5e08a35d21599fa528f30, regionState=CLOSED 2023-11-25 12:54:46,470 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700916886470"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916886470"}]},"ts":"1700916886470"} 2023-11-25 12:54:46,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=68, resume processing ppid=67 2023-11-25 12:54:46,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 01cde85952d5e08a35d21599fa528f30, server=jenkins-hbase4.apache.org,37051,1700916801082 in 159 msec 2023-11-25 12:54:46,473 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=01cde85952d5e08a35d21599fa528f30, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=true 2023-11-25 12:54:46,623 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=01cde85952d5e08a35d21599fa528f30, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:46,624 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700916886623"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916886623"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916886623"}]},"ts":"1700916886623"} 2023-11-25 12:54:46,625 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 01cde85952d5e08a35d21599fa528f30, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:46,777 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:46,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:46,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 01cde85952d5e08a35d21599fa528f30, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:54:46,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:46,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:46,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:46,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:46,781 INFO [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:46,782 DEBUG [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1 2023-11-25 12:54:46,782 DEBUG [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1 2023-11-25 12:54:46,783 INFO [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01cde85952d5e08a35d21599fa528f30 columnFamilyName family1 2023-11-25 12:54:46,788 DEBUG [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/bbafb68072c143a4908efcd9de6c6363 2023-11-25 12:54:46,791 DEBUG [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/family1/f499e74f69f34e018d6f0ef1ffa6a128_SeqId_52_ 2023-11-25 12:54:46,791 INFO [StoreOpener-01cde85952d5e08a35d21599fa528f30-1] regionserver.HStore(310): Store=01cde85952d5e08a35d21599fa528f30/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:46,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:46,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:46,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:54:46,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 01cde85952d5e08a35d21599fa528f30; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65333335, jitterRate=-0.026457443833351135}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-25 12:54:46,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:54:46,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30., pid=69, masterSystemTime=1700916886777 2023-11-25 12:54:46,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:46,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:54:46,798 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=01cde85952d5e08a35d21599fa528f30, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:46,798 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700916886798"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916886798"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916886798"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916886798"}]},"ts":"1700916886798"} 2023-11-25 12:54:46,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=69, resume processing ppid=67 2023-11-25 12:54:46,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 01cde85952d5e08a35d21599fa528f30, server=jenkins-hbase4.apache.org,37051,1700916801082 in 174 msec 2023-11-25 12:54:46,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=67, resume processing ppid=66 2023-11-25 12:54:46,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=01cde85952d5e08a35d21599fa528f30, REOPEN/MOVE in 491 msec 2023-11-25 12:54:46,803 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=66, resume processing ppid=65 2023-11-25 12:54:46,803 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 495 msec 2023-11-25 12:54:46,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 914 msec 2023-11-25 12:54:46,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-25 12:54:46,807 INFO [Listener at localhost/45289] compactions.TestMobCompactor(278): alter status finished 2023-11-25 12:54:46,807 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38201] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-25 12:54:46,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-25 12:54:46,809 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-25 12:54:46,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:46,810 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700917486810 2023-11-25 12:54:46,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-25 12:54:46,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-25 12:54:46,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-25 12:54:46,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] zookeeper.ReadOnlyZKClient(139): Connect 0x261608ee to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:54:46,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b235e81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:54:46,816 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:46,816 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:46,817 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:46,817 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:46,817 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:46,817 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:46,817 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:46,817 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-25 12:54:46,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-25 12:54:46,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:46,818 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-25 12:54:46,818 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 10 msec 2023-11-25 12:54:46,877 INFO [Listener at localhost/45289] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=248 (was 254), OpenFileDescriptor=647 (was 658), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=182 (was 197), ProcessCount=172 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=8079 (was 8132) 2023-11-25 12:54:46,887 INFO [Listener at localhost/45289] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=248, OpenFileDescriptor=647, MaxFileDescriptor=60000, SystemLoadAverage=182, ProcessCount=172, AvailableMemoryMB=8079 2023-11-25 12:54:46,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-25 12:54:46,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-25 12:54:46,892 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-25 12:54:46,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-25 12:54:46,893 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-25 12:54:46,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-25 12:54:46,894 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d 2023-11-25 12:54:46,895 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d empty. 2023-11-25 12:54:46,895 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d 2023-11-25 12:54:46,895 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-25 12:54:46,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-25 12:54:47,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-25 12:54:47,303 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-25 12:54:47,304 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 306579c5069ae2c89900fe076de7817d, NAME => 'testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:54:47,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-25 12:54:47,710 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:47,711 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 306579c5069ae2c89900fe076de7817d, disabling compactions & flushes 2023-11-25 12:54:47,711 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. 2023-11-25 12:54:47,711 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. 2023-11-25 12:54:47,711 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. after waiting 0 ms 2023-11-25 12:54:47,711 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. 2023-11-25 12:54:47,711 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. 2023-11-25 12:54:47,711 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 306579c5069ae2c89900fe076de7817d: 2023-11-25 12:54:47,713 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-25 12:54:47,714 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700916887714"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916887714"}]},"ts":"1700916887714"} 2023-11-25 12:54:47,715 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-25 12:54:47,716 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-25 12:54:47,716 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916887716"}]},"ts":"1700916887716"} 2023-11-25 12:54:47,717 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-25 12:54:47,720 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=306579c5069ae2c89900fe076de7817d, ASSIGN}] 2023-11-25 12:54:47,722 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=306579c5069ae2c89900fe076de7817d, ASSIGN 2023-11-25 12:54:47,722 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=306579c5069ae2c89900fe076de7817d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:54:47,873 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=306579c5069ae2c89900fe076de7817d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:47,873 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700916887873"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916887873"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916887873"}]},"ts":"1700916887873"} 2023-11-25 12:54:47,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 306579c5069ae2c89900fe076de7817d, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:47,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-25 12:54:48,026 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:48,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. 2023-11-25 12:54:48,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 306579c5069ae2c89900fe076de7817d, NAME => 'testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d.', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:54:48,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-25 12:54:48,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-25 12:54:48,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 306579c5069ae2c89900fe076de7817d 2023-11-25 12:54:48,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:48,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 306579c5069ae2c89900fe076de7817d 2023-11-25 12:54:48,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 306579c5069ae2c89900fe076de7817d 2023-11-25 12:54:48,033 INFO [StoreOpener-306579c5069ae2c89900fe076de7817d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 306579c5069ae2c89900fe076de7817d 2023-11-25 12:54:48,035 DEBUG [StoreOpener-306579c5069ae2c89900fe076de7817d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1 2023-11-25 12:54:48,035 DEBUG [StoreOpener-306579c5069ae2c89900fe076de7817d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1 2023-11-25 12:54:48,035 INFO [StoreOpener-306579c5069ae2c89900fe076de7817d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 306579c5069ae2c89900fe076de7817d columnFamilyName f1 2023-11-25 12:54:48,036 INFO [StoreOpener-306579c5069ae2c89900fe076de7817d-1] regionserver.HStore(310): Store=306579c5069ae2c89900fe076de7817d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:48,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d 2023-11-25 12:54:48,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d 2023-11-25 12:54:48,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 306579c5069ae2c89900fe076de7817d 2023-11-25 12:54:48,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:54:48,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 306579c5069ae2c89900fe076de7817d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60429466, jitterRate=-0.09953078627586365}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-25 12:54:48,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 306579c5069ae2c89900fe076de7817d: 2023-11-25 12:54:48,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d., pid=73, masterSystemTime=1700916888026 2023-11-25 12:54:48,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. 2023-11-25 12:54:48,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. 2023-11-25 12:54:48,044 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=306579c5069ae2c89900fe076de7817d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:48,044 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700916888044"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916888044"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916888044"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916888044"}]},"ts":"1700916888044"} 2023-11-25 12:54:48,047 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=73, resume processing ppid=72 2023-11-25 12:54:48,047 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 306579c5069ae2c89900fe076de7817d, server=jenkins-hbase4.apache.org,37051,1700916801082 in 170 msec 2023-11-25 12:54:48,048 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=72, resume processing ppid=71 2023-11-25 12:54:48,048 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=306579c5069ae2c89900fe076de7817d, ASSIGN in 327 msec 2023-11-25 12:54:48,048 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-25 12:54:48,049 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916888049"}]},"ts":"1700916888049"} 2023-11-25 12:54:48,050 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-25 12:54:48,053 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-25 12:54:48,054 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1630 sec 2023-11-25 12:54:48,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-25 12:54:48,999 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-25 12:54:48,999 DEBUG [Listener at localhost/45289] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-25 12:54:49,001 INFO [Listener at localhost/45289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-25 12:54:49,003 INFO [Listener at localhost/45289] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-25 12:54:49,004 INFO [Listener at localhost/45289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-25 12:54:49,004 INFO [Listener at localhost/45289] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-25 12:54:49,007 INFO [Listener at localhost/45289] regionserver.HRegion(2745): Flushing 306579c5069ae2c89900fe076de7817d 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-25 12:54:49,420 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311256936d99ce0c64bb5b8cf87d0af88b5e4 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311256936d99ce0c64bb5b8cf87d0af88b5e4 2023-11-25 12:54:49,826 INFO [Listener at localhost/45289] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/.tmp/f1/625e7cef05b04158b2cf25a5f6e21b4b 2023-11-25 12:54:49,831 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/.tmp/f1/625e7cef05b04158b2cf25a5f6e21b4b as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b 2023-11-25 12:54:49,835 INFO [Listener at localhost/45289] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b, entries=1, sequenceid=5, filesize=4.9 K 2023-11-25 12:54:49,836 INFO [Listener at localhost/45289] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 306579c5069ae2c89900fe076de7817d in 829ms, sequenceid=5, compaction requested=false 2023-11-25 12:54:49,836 DEBUG [Listener at localhost/45289] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-25 12:54:49,837 DEBUG [Listener at localhost/45289] regionserver.HRegion(2446): Flush status journal for 306579c5069ae2c89900fe076de7817d: 2023-11-25 12:54:49,839 INFO [Listener at localhost/45289] regionserver.HRegion(2745): Flushing 306579c5069ae2c89900fe076de7817d 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-25 12:54:50,251 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125976dd089c6e24ef0907eabca058d48ad to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231125976dd089c6e24ef0907eabca058d48ad 2023-11-25 12:54:50,517 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-25 12:54:50,713 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x261608ee to 127.0.0.1:63200 2023-11-25 12:54:50,713 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-25 12:54:50,713 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:54:50,713 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:54:50,713 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1deaddbb to 127.0.0.1:63200 2023-11-25 12:54:50,713 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:54:50,713 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:54:50,713 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f650c61 to 127.0.0.1:63200 2023-11-25 12:54:50,714 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:54:50,714 INFO [Listener at localhost/45289] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/.tmp/f1/58bae0f1f1224e45b7ceccde15d0adb7 2023-11-25 12:54:50,720 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-25 12:54:50,720 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-11-25 12:54:50,721 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/.tmp/f1/58bae0f1f1224e45b7ceccde15d0adb7 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7 2023-11-25 12:54:50,725 INFO [Listener at localhost/45289] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7, entries=1, sequenceid=9, filesize=4.9 K 2023-11-25 12:54:50,727 INFO [Listener at localhost/45289] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 306579c5069ae2c89900fe076de7817d in 888ms, sequenceid=9, compaction requested=false 2023-11-25 12:54:50,727 DEBUG [Listener at localhost/45289] regionserver.HRegion(2446): Flush status journal for 306579c5069ae2c89900fe076de7817d: 2023-11-25 12:54:50,728 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38201] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-25 12:54:50,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-25 12:54:50,731 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-25 12:54:50,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:50,731 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700917490731 2023-11-25 12:54:50,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-25 12:54:50,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-25 12:54:50,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-25 12:54:50,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] zookeeper.ReadOnlyZKClient(139): Connect 0x21d878dd to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:54:50,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@aeed31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:54:50,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231125 for table='testGetAfterCompaction' and column='f1' 2023-11-25 12:54:50,780 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:50,780 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:50,831 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:50,831 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:50,882 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:50,882 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:50,933 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:50,933 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:50,984 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:50,984 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,034 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,035 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,085 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,086 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,136 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,136 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,187 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,187 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,238 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,238 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,289 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,289 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,340 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,340 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,390 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,390 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,441 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,441 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,492 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,492 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,543 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,543 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,563 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125a8742dfbd5af4819bc51179d8fe18f17 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231125a8742dfbd5af4819bc51179d8fe18f17 2023-11-25 12:54:51,563 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231125 table='testGetAfterCompaction' column='f1' 2023-11-25 12:54:51,580 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:54:51,582 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:54:51,588 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:54:51,589 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:54:51,594 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,594 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,598 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231125/f1/343a1cdb9ae7438abc06b88eb5ca160e first=Optional[r1] last=Optional[r2] 2023-11-25 12:54:51,599 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{f1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231125/f1/343a1cdb9ae7438abc06b88eb5ca160e}] 2023-11-25 12:54:51,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231125/f1/343a1cdb9ae7438abc06b88eb5ca160e for inclusion in 306579c5069ae2c89900fe076de7817d/f1 2023-11-25 12:54:51,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-25 12:54:51,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:54:51,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 306579c5069ae2c89900fe076de7817d: 2023-11-25 12:54:51,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231125/f1/343a1cdb9ae7438abc06b88eb5ca160e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testGetAfterCompaction__f5vofsib9bpcti6v051oecosorn95bbian0bo8lqjd0is2628nukrko7i1p2i258/f1/343a1cdb9ae7438abc06b88eb5ca160e 2023-11-25 12:54:51,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testGetAfterCompaction__f5vofsib9bpcti6v051oecosorn95bbian0bo8lqjd0is2628nukrko7i1p2i258/f1/343a1cdb9ae7438abc06b88eb5ca160e as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_ 2023-11-25 12:54:51,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testGetAfterCompaction__f5vofsib9bpcti6v051oecosorn95bbian0bo8lqjd0is2628nukrko7i1p2i258/f1/343a1cdb9ae7438abc06b88eb5ca160e into 306579c5069ae2c89900fe076de7817d/f1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_ - updating store file list. 2023-11-25 12:54:51,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_ into 306579c5069ae2c89900fe076de7817d/f1 2023-11-25 12:54:51,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testGetAfterCompaction__f5vofsib9bpcti6v051oecosorn95bbian0bo8lqjd0is2628nukrko7i1p2i258/f1/343a1cdb9ae7438abc06b88eb5ca160e into 306579c5069ae2c89900fe076de7817d/f1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_) 2023-11-25 12:54:51,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testGetAfterCompaction__f5vofsib9bpcti6v051oecosorn95bbian0bo8lqjd0is2628nukrko7i1p2i258/f1/343a1cdb9ae7438abc06b88eb5ca160e 2023-11-25 12:54:51,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(1912): 306579c5069ae2c89900fe076de7817d/f1 is initiating minor compaction 2023-11-25 12:54:51,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@477473e1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:51,612 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 306579c5069ae2c89900fe076de7817d/f1 in testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. 2023-11-25 12:54:51,612 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/.tmp, totalSize=10.0 K 2023-11-25 12:54:51,612 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 58bae0f1f1224e45b7ceccde15d0adb7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-25 12:54:51,612 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 9029364214f74255b01b5c97c726f76c_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-25 12:54:51,614 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231125 table='testGetAfterCompaction' column='f1' 2023-11-25 12:54:51,614 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:51,616 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311256936d99ce0c64bb5b8cf87d0af88b5e4 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311256936d99ce0c64bb5b8cf87d0af88b5e4 2023-11-25 12:54:51,617 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231125976dd089c6e24ef0907eabca058d48ad to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231125976dd089c6e24ef0907eabca058d48ad 2023-11-25 12:54:51,617 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-25 12:54:51,617 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231125' 2023-11-25 12:54:51,618 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231125 for table='testGetAfterCompaction' and column='f1' 2023-11-25 12:54:51,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-25 12:54:51,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:54:51,619 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-25 12:54:51,620 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 306579c5069ae2c89900fe076de7817d#f1#compaction#75 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-25 12:54:51,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 890 msec 2023-11-25 12:54:51,644 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,644 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,644 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:51,648 DEBUG [Listener at localhost/45289] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-25 12:54:51,651 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-25 12:54:51,651 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37051] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. 2023-11-25 12:54:51,652 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37051] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-25 12:54:51,652 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-25 12:54:51,652 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37051] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-25 12:54:51,652 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37051] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. because compaction request was cancelled 2023-11-25 12:54:51,703 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,703 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,704 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:51,754 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,754 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,754 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:51,805 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,805 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,805 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:51,856 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,856 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,856 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:51,907 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,907 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,907 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:51,958 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,958 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:51,958 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:52,009 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,009 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,009 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:52,060 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,060 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,060 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:52,111 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,111 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,111 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:52,162 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,162 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,162 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:52,213 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,213 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,213 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:52,264 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,264 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,264 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:52,315 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,315 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,315 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:52,366 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,366 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,366 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:52,417 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,417 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,417 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:52,438 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/.tmp/f1/b294e2f778944143a0cf1024a52476b1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/b294e2f778944143a0cf1024a52476b1 2023-11-25 12:54:52,442 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 306579c5069ae2c89900fe076de7817d/f1 of 306579c5069ae2c89900fe076de7817d into b294e2f778944143a0cf1024a52476b1(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:54:52,442 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 306579c5069ae2c89900fe076de7817d: 2023-11-25 12:54:52,442 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1700916891611; duration=0sec 2023-11-25 12:54:52,443 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:54:52,468 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916890713; access_time=1700916889841; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,468 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,468 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700916891559; access_time=1700916890750; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-25 12:54:52,468 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/b294e2f778944143a0cf1024a52476b1; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700916892433; access_time=1700916891617; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_] to archive 2023-11-25 12:54:52,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:54:52,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/58bae0f1f1224e45b7ceccde15d0adb7 2023-11-25 12:54:52,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/9029364214f74255b01b5c97c726f76c_SeqId_12_ 2023-11-25 12:54:52,518 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700916889826; access_time=1700916889010; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,518 INFO [Listener at localhost/45289] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/b294e2f778944143a0cf1024a52476b1; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700916892433; access_time=1700916891617; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-25 12:54:52,636 INFO [Listener at localhost/45289] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-25 12:54:52,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-11-25 12:54:52,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-25 12:54:52,648 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916892648"}]},"ts":"1700916892648"} 2023-11-25 12:54:52,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-25 12:54:52,649 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-25 12:54:52,651 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-25 12:54:52,652 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=306579c5069ae2c89900fe076de7817d, UNASSIGN}] 2023-11-25 12:54:52,653 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=306579c5069ae2c89900fe076de7817d, UNASSIGN 2023-11-25 12:54:52,654 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=306579c5069ae2c89900fe076de7817d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:52,654 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700916892654"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916892654"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916892654"}]},"ts":"1700916892654"} 2023-11-25 12:54:52,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 306579c5069ae2c89900fe076de7817d, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:52,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-25 12:54:52,807 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:52,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 306579c5069ae2c89900fe076de7817d 2023-11-25 12:54:52,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 306579c5069ae2c89900fe076de7817d, disabling compactions & flushes 2023-11-25 12:54:52,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. 2023-11-25 12:54:52,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. 2023-11-25 12:54:52,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. after waiting 1 ms 2023-11-25 12:54:52,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. 2023-11-25 12:54:52,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-25 12:54:52,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-25 12:54:52,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d. 2023-11-25 12:54:52,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 306579c5069ae2c89900fe076de7817d: 2023-11-25 12:54:52,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 306579c5069ae2c89900fe076de7817d 2023-11-25 12:54:52,815 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=306579c5069ae2c89900fe076de7817d, regionState=CLOSED 2023-11-25 12:54:52,815 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700916892815"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916892815"}]},"ts":"1700916892815"} 2023-11-25 12:54:52,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=77, resume processing ppid=76 2023-11-25 12:54:52,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 306579c5069ae2c89900fe076de7817d, server=jenkins-hbase4.apache.org,37051,1700916801082 in 161 msec 2023-11-25 12:54:52,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=76, resume processing ppid=75 2023-11-25 12:54:52,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=306579c5069ae2c89900fe076de7817d, UNASSIGN in 166 msec 2023-11-25 12:54:52,820 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916892820"}]},"ts":"1700916892820"} 2023-11-25 12:54:52,821 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-25 12:54:52,822 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-25 12:54:52,824 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 182 msec 2023-11-25 12:54:52,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-25 12:54:52,952 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-25 12:54:52,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-11-25 12:54:52,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-25 12:54:52,963 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-25 12:54:52,965 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-25 12:54:52,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-25 12:54:52,967 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d 2023-11-25 12:54:52,970 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1, FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/recovered.edits] 2023-11-25 12:54:52,974 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/625e7cef05b04158b2cf25a5f6e21b4b 2023-11-25 12:54:52,975 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/b294e2f778944143a0cf1024a52476b1 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/f1/b294e2f778944143a0cf1024a52476b1 2023-11-25 12:54:52,978 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/recovered.edits/15.seqid to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d/recovered.edits/15.seqid 2023-11-25 12:54:52,979 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testGetAfterCompaction/306579c5069ae2c89900fe076de7817d 2023-11-25 12:54:52,979 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-25 12:54:52,979 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-25 12:54:52,980 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-25 12:54:52,983 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231125a8742dfbd5af4819bc51179d8fe18f17 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231125a8742dfbd5af4819bc51179d8fe18f17 2023-11-25 12:54:52,984 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-25 12:54:52,986 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-25 12:54:53,018 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-25 12:54:53,021 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-25 12:54:53,022 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-25 12:54:53,022 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-25 12:54:53,022 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700916893022"}]},"ts":"9223372036854775807"} 2023-11-25 12:54:53,024 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-25 12:54:53,024 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 306579c5069ae2c89900fe076de7817d, NAME => 'testGetAfterCompaction,,1700916886890.306579c5069ae2c89900fe076de7817d.', STARTKEY => '', ENDKEY => ''}] 2023-11-25 12:54:53,024 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-25 12:54:53,024 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1700916893024"}]},"ts":"9223372036854775807"} 2023-11-25 12:54:53,026 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-25 12:54:53,028 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-25 12:54:53,029 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 71 msec 2023-11-25 12:54:53,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-25 12:54:53,067 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-25 12:54:53,080 INFO [Listener at localhost/45289] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=239 (was 248), OpenFileDescriptor=629 (was 647), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=170 (was 182), ProcessCount=170 (was 172), AvailableMemoryMB=8014 (was 8079) 2023-11-25 12:54:53,091 INFO [Listener at localhost/45289] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=239, OpenFileDescriptor=629, MaxFileDescriptor=60000, SystemLoadAverage=170, ProcessCount=170, AvailableMemoryMB=8013 2023-11-25 12:54:53,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-25 12:54:53,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-25 12:54:53,096 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-25 12:54:53,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-25 12:54:53,097 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-25 12:54:53,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-25 12:54:53,099 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08 2023-11-25 12:54:53,099 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617 2023-11-25 12:54:53,099 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:54:53,100 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08 empty. 2023-11-25 12:54:53,100 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b empty. 2023-11-25 12:54:53,100 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617 empty. 2023-11-25 12:54:53,100 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08 2023-11-25 12:54:53,100 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:54:53,100 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617 2023-11-25 12:54:53,100 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-25 12:54:53,110 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-25 12:54:53,112 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 67ff462843156320a06b388981969e08, NAME => 'testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:54:53,112 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => b003b003481e082b6bae5bad39b1e617, NAME => 'testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:54:53,112 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 83bb1fd938e2dac427ea10eb612df94b, NAME => 'testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:54:53,122 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:53,122 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 83bb1fd938e2dac427ea10eb612df94b, disabling compactions & flushes 2023-11-25 12:54:53,122 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:54:53,122 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:54:53,122 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. after waiting 0 ms 2023-11-25 12:54:53,122 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:54:53,122 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:54:53,122 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:54:53,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-25 12:54:53,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-25 12:54:53,523 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:53,523 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:53,523 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 67ff462843156320a06b388981969e08, disabling compactions & flushes 2023-11-25 12:54:53,523 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing b003b003481e082b6bae5bad39b1e617, disabling compactions & flushes 2023-11-25 12:54:53,523 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:54:53,523 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:54:53,523 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. after waiting 0 ms 2023-11-25 12:54:53,523 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:54:53,523 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:54:53,523 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:54:53,523 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:54:53,523 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:54:53,523 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. after waiting 0 ms 2023-11-25 12:54:53,523 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:54:53,524 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:54:53,524 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:54:53,526 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-25 12:54:53,527 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916893526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916893526"}]},"ts":"1700916893526"} 2023-11-25 12:54:53,527 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916893526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916893526"}]},"ts":"1700916893526"} 2023-11-25 12:54:53,527 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700916893526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916893526"}]},"ts":"1700916893526"} 2023-11-25 12:54:53,529 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-25 12:54:53,529 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-25 12:54:53,529 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916893529"}]},"ts":"1700916893529"} 2023-11-25 12:54:53,530 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-25 12:54:53,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=67ff462843156320a06b388981969e08, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b003b003481e082b6bae5bad39b1e617, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=83bb1fd938e2dac427ea10eb612df94b, ASSIGN}] 2023-11-25 12:54:53,536 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=83bb1fd938e2dac427ea10eb612df94b, ASSIGN 2023-11-25 12:54:53,536 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=67ff462843156320a06b388981969e08, ASSIGN 2023-11-25 12:54:53,536 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b003b003481e082b6bae5bad39b1e617, ASSIGN 2023-11-25 12:54:53,536 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=83bb1fd938e2dac427ea10eb612df94b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:54:53,536 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=67ff462843156320a06b388981969e08, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:54:53,537 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b003b003481e082b6bae5bad39b1e617, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:54:53,688 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b003b003481e082b6bae5bad39b1e617, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:53,688 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=83bb1fd938e2dac427ea10eb612df94b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:53,688 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=67ff462843156320a06b388981969e08, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:53,688 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700916893688"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916893688"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916893688"}]},"ts":"1700916893688"} 2023-11-25 12:54:53,688 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916893688"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916893688"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916893688"}]},"ts":"1700916893688"} 2023-11-25 12:54:53,688 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916893688"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916893688"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916893688"}]},"ts":"1700916893688"} 2023-11-25 12:54:53,690 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure b003b003481e082b6bae5bad39b1e617, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:53,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure 83bb1fd938e2dac427ea10eb612df94b, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:53,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure 67ff462843156320a06b388981969e08, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:54:53,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-25 12:54:53,844 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:53,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:54:53,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 67ff462843156320a06b388981969e08, NAME => 'testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.', STARTKEY => '', ENDKEY => '1'} 2023-11-25 12:54:53,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 67ff462843156320a06b388981969e08 2023-11-25 12:54:53,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:53,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 67ff462843156320a06b388981969e08 2023-11-25 12:54:53,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 67ff462843156320a06b388981969e08 2023-11-25 12:54:53,849 INFO [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 67ff462843156320a06b388981969e08 2023-11-25 12:54:53,850 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1 2023-11-25 12:54:53,850 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1 2023-11-25 12:54:53,851 INFO [StoreOpener-67ff462843156320a06b388981969e08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67ff462843156320a06b388981969e08 columnFamilyName family1 2023-11-25 12:54:53,853 INFO [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(310): Store=67ff462843156320a06b388981969e08/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:53,854 INFO [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 67ff462843156320a06b388981969e08 2023-11-25 12:54:53,855 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2 2023-11-25 12:54:53,855 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2 2023-11-25 12:54:53,855 INFO [StoreOpener-67ff462843156320a06b388981969e08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67ff462843156320a06b388981969e08 columnFamilyName family2 2023-11-25 12:54:53,856 INFO [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(310): Store=67ff462843156320a06b388981969e08/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:53,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08 2023-11-25 12:54:53,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08 2023-11-25 12:54:53,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-25 12:54:53,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 67ff462843156320a06b388981969e08 2023-11-25 12:54:53,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:54:53,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 67ff462843156320a06b388981969e08; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61199530, jitterRate=-0.08805593848228455}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-25 12:54:53,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:54:53,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08., pid=85, masterSystemTime=1700916893844 2023-11-25 12:54:53,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:54:53,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:54:53,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:54:53,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 83bb1fd938e2dac427ea10eb612df94b, NAME => 'testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.', STARTKEY => '2', ENDKEY => ''} 2023-11-25 12:54:53,865 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=67ff462843156320a06b388981969e08, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:53,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:54:53,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:53,865 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916893865"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916893865"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916893865"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916893865"}]},"ts":"1700916893865"} 2023-11-25 12:54:53,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:54:53,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:54:53,866 INFO [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:54:53,868 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1 2023-11-25 12:54:53,868 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1 2023-11-25 12:54:53,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=85, resume processing ppid=80 2023-11-25 12:54:53,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure 67ff462843156320a06b388981969e08, server=jenkins-hbase4.apache.org,37051,1700916801082 in 176 msec 2023-11-25 12:54:53,868 INFO [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83bb1fd938e2dac427ea10eb612df94b columnFamilyName family1 2023-11-25 12:54:53,869 INFO [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(310): Store=83bb1fd938e2dac427ea10eb612df94b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:53,869 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=67ff462843156320a06b388981969e08, ASSIGN in 335 msec 2023-11-25 12:54:53,869 INFO [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:54:53,870 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2 2023-11-25 12:54:53,871 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2 2023-11-25 12:54:53,871 INFO [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83bb1fd938e2dac427ea10eb612df94b columnFamilyName family2 2023-11-25 12:54:53,871 INFO [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(310): Store=83bb1fd938e2dac427ea10eb612df94b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:53,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:54:53,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:54:53,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-25 12:54:53,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:54:53,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:54:53,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 83bb1fd938e2dac427ea10eb612df94b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65733145, jitterRate=-0.020499810576438904}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-25 12:54:53,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:54:53,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b., pid=84, masterSystemTime=1700916893844 2023-11-25 12:54:53,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:54:53,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:54:53,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:54:53,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b003b003481e082b6bae5bad39b1e617, NAME => 'testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.', STARTKEY => '1', ENDKEY => '2'} 2023-11-25 12:54:53,879 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=83bb1fd938e2dac427ea10eb612df94b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:53,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b003b003481e082b6bae5bad39b1e617 2023-11-25 12:54:53,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:54:53,879 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916893879"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916893879"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916893879"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916893879"}]},"ts":"1700916893879"} 2023-11-25 12:54:53,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b003b003481e082b6bae5bad39b1e617 2023-11-25 12:54:53,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b003b003481e082b6bae5bad39b1e617 2023-11-25 12:54:53,880 INFO [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b003b003481e082b6bae5bad39b1e617 2023-11-25 12:54:53,882 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1 2023-11-25 12:54:53,882 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1 2023-11-25 12:54:53,882 INFO [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b003b003481e082b6bae5bad39b1e617 columnFamilyName family1 2023-11-25 12:54:53,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=84, resume processing ppid=82 2023-11-25 12:54:53,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure 83bb1fd938e2dac427ea10eb612df94b, server=jenkins-hbase4.apache.org,37051,1700916801082 in 189 msec 2023-11-25 12:54:53,883 INFO [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(310): Store=b003b003481e082b6bae5bad39b1e617/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:53,883 INFO [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b003b003481e082b6bae5bad39b1e617 2023-11-25 12:54:53,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=83bb1fd938e2dac427ea10eb612df94b, ASSIGN in 348 msec 2023-11-25 12:54:53,884 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2 2023-11-25 12:54:53,884 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2 2023-11-25 12:54:53,884 INFO [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b003b003481e082b6bae5bad39b1e617 columnFamilyName family2 2023-11-25 12:54:53,885 INFO [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(310): Store=b003b003481e082b6bae5bad39b1e617/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:54:53,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617 2023-11-25 12:54:53,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617 2023-11-25 12:54:53,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-25 12:54:53,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b003b003481e082b6bae5bad39b1e617 2023-11-25 12:54:53,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:54:53,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b003b003481e082b6bae5bad39b1e617; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69437595, jitterRate=0.034700796008110046}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-25 12:54:53,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:54:53,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617., pid=83, masterSystemTime=1700916893844 2023-11-25 12:54:53,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:54:53,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:54:53,893 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b003b003481e082b6bae5bad39b1e617, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:53,893 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700916893893"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916893893"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916893893"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916893893"}]},"ts":"1700916893893"} 2023-11-25 12:54:53,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=83, resume processing ppid=81 2023-11-25 12:54:53,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure b003b003481e082b6bae5bad39b1e617, server=jenkins-hbase4.apache.org,37051,1700916801082 in 204 msec 2023-11-25 12:54:53,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=81, resume processing ppid=79 2023-11-25 12:54:53,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b003b003481e082b6bae5bad39b1e617, ASSIGN in 362 msec 2023-11-25 12:54:53,897 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-25 12:54:53,898 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916893897"}]},"ts":"1700916893897"} 2023-11-25 12:54:53,899 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-25 12:54:53,901 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-25 12:54:53,902 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 807 msec 2023-11-25 12:54:54,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-25 12:54:54,201 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-25 12:54:54,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:54:54,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:54:54,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:54:54,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:54,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-25 12:54:54,215 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-25 12:54:54,215 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:54,215 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-25 12:54:54,215 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-25 12:54:54,216 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:54,216 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:54,218 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:54,218 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:54,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:54,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:54,219 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:54,219 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:54,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:54,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:54,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:54,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:54,220 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-25 12:54:54,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-25 12:54:54,220 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-25 12:54:54,220 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:54,220 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-25 12:54:54,220 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:54:54,220 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. started... 2023-11-25 12:54:54,225 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:54:54,225 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b003b003481e082b6bae5bad39b1e617 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-25 12:54:54,225 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:54:54,225 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. started... 2023-11-25 12:54:54,225 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:54:54,225 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:54,226 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 83bb1fd938e2dac427ea10eb612df94b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-25 12:54:54,225 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. started... 2023-11-25 12:54:54,226 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 67ff462843156320a06b388981969e08 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-25 12:54:54,645 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112546c57f4a81374d0bb97e16a0a03959ab to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112546c57f4a81374d0bb97e16a0a03959ab 2023-11-25 12:54:54,645 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112578fbe71b92a84181b85ecbd9a0ee1d26 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112578fbe71b92a84181b85ecbd9a0ee1d26 2023-11-25 12:54:54,646 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125bca32b8c07b84895815709d9bd67ad79 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125bca32b8c07b84895815709d9bd67ad79 2023-11-25 12:54:54,656 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family1/1704ad43983c480b94486ba126258b57 2023-11-25 12:54:54,657 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family1/07726c1afd6241899cd789707c62d600 2023-11-25 12:54:55,057 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family1/9a63db5e301740ed967c31caa1581f4c 2023-11-25 12:54:55,074 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125248dcc4a1b8e41c68f984c6796aa4505 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231125248dcc4a1b8e41c68f984c6796aa4505 2023-11-25 12:54:55,074 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125af43ed0690124f779550895faadcff20 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231125af43ed0690124f779550895faadcff20 2023-11-25 12:54:55,471 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125b4c4ef09feba4e6796bff3cf7efe2d9c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231125b4c4ef09feba4e6796bff3cf7efe2d9c 2023-11-25 12:54:55,478 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family2/ae489c65d08a4d8cbc577a6328d55457 2023-11-25 12:54:55,478 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family2/ed5e90748066410499e8750ef2575697 2023-11-25 12:54:55,482 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family1/1704ad43983c480b94486ba126258b57 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/1704ad43983c480b94486ba126258b57 2023-11-25 12:54:55,482 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family1/07726c1afd6241899cd789707c62d600 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/07726c1afd6241899cd789707c62d600 2023-11-25 12:54:55,486 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/1704ad43983c480b94486ba126258b57, entries=4, sequenceid=5, filesize=5.4 K 2023-11-25 12:54:55,486 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/07726c1afd6241899cd789707c62d600, entries=4, sequenceid=5, filesize=5.4 K 2023-11-25 12:54:55,486 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family2/ae489c65d08a4d8cbc577a6328d55457 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/ae489c65d08a4d8cbc577a6328d55457 2023-11-25 12:54:55,487 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family2/ed5e90748066410499e8750ef2575697 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed5e90748066410499e8750ef2575697 2023-11-25 12:54:55,490 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/ae489c65d08a4d8cbc577a6328d55457, entries=2, sequenceid=5, filesize=5.1 K 2023-11-25 12:54:55,491 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed5e90748066410499e8750ef2575697, entries=2, sequenceid=5, filesize=5.1 K 2023-11-25 12:54:55,491 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 83bb1fd938e2dac427ea10eb612df94b in 1265ms, sequenceid=5, compaction requested=false 2023-11-25 12:54:55,491 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-25 12:54:55,491 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 67ff462843156320a06b388981969e08 in 1265ms, sequenceid=5, compaction requested=false 2023-11-25 12:54:55,491 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-25 12:54:55,492 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:54:55,493 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:54:55,493 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:54:55,493 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:54:55,493 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:54:55,493 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:54:55,876 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family2/515ef8a66e28483d84c469f3c2d7599f 2023-11-25 12:54:55,880 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family1/9a63db5e301740ed967c31caa1581f4c as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/9a63db5e301740ed967c31caa1581f4c 2023-11-25 12:54:55,883 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/9a63db5e301740ed967c31caa1581f4c, entries=4, sequenceid=5, filesize=5.4 K 2023-11-25 12:54:55,884 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family2/515ef8a66e28483d84c469f3c2d7599f as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/515ef8a66e28483d84c469f3c2d7599f 2023-11-25 12:54:55,887 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/515ef8a66e28483d84c469f3c2d7599f, entries=2, sequenceid=5, filesize=5.1 K 2023-11-25 12:54:55,888 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b003b003481e082b6bae5bad39b1e617 in 1663ms, sequenceid=5, compaction requested=false 2023-11-25 12:54:55,888 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:54:55,888 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:54:55,888 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:54:55,888 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:54:55,888 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:55,888 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-25 12:54:55,888 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-25 12:54:55,890 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:55,890 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:55,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:55,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:55,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:55,890 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:55,890 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:55,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:55,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-25 12:54:55,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78cb7467[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:55,892 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-25 12:54:55,892 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:55,893 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:55,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:55,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:55,893 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-25 12:54:55,893 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-25 12:54:55,893 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:55,893 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:55,893 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:55,894 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:55,895 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-25 12:54:55,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:55,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:55,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:55,895 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:55,895 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-25 12:54:55,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:55,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:55,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:55,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:55,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-25 12:54:55,897 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-25 12:54:55,897 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:55,897 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:55,897 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-25 12:54:55,897 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:55,900 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:55,900 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:55,900 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:55,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:55,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:55,900 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:55,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:55,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:55,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:55,901 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:55,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:55,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:55,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:55,904 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:55,904 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:55,904 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:55,904 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:55,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-25 12:54:55,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:55,904 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:55,904 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:55,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:55,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:55,904 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:55,904 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:55,904 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:55,904 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:55,904 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:55,904 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:55,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:55,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:56,004 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:56,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:56,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:54:56,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:54:56,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:54:56,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:56,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:56,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-25 12:54:56,012 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-25 12:54:56,012 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:56,012 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-25 12:54:56,012 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-25 12:54:56,012 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:56,012 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:56,014 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,014 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:56,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:56,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:56,014 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,014 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:56,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:56,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:56,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:56,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:56,015 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-25 12:54:56,015 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-25 12:54:56,015 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-25 12:54:56,015 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-25 12:54:56,015 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:56,015 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-25 12:54:56,016 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:54:56,016 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. started... 2023-11-25 12:54:56,016 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:54:56,016 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b003b003481e082b6bae5bad39b1e617 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-25 12:54:56,016 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. started... 2023-11-25 12:54:56,016 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 83bb1fd938e2dac427ea10eb612df94b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-25 12:54:56,019 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:54:56,019 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:56,019 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:54:56,020 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. started... 2023-11-25 12:54:56,020 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 67ff462843156320a06b388981969e08 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-25 12:54:56,042 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112571aad81045734d62be9ab3c0adf6307b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112571aad81045734d62be9ab3c0adf6307b 2023-11-25 12:54:56,446 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125220526c40aec47bb854d07d1d573ac46 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125220526c40aec47bb854d07d1d573ac46 2023-11-25 12:54:56,447 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311255d76cd16f19f43b195ed2271761207d6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311255d76cd16f19f43b195ed2271761207d6 2023-11-25 12:54:56,447 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family1/9aea3ef5e85b48beb6d198de95dc2e9d 2023-11-25 12:54:56,451 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family1/471575781e8a4ed1bfd7cb92ac6782f1 2023-11-25 12:54:56,452 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family1/0484872de8294cbd8239c4b9cdaa8a93 2023-11-25 12:54:56,462 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125d2adfd2beeb04831b4ace28295fffeb7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231125d2adfd2beeb04831b4ace28295fffeb7 2023-11-25 12:54:56,466 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112528cca0c6a19e437aada9d66cc7ef5fd1 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112528cca0c6a19e437aada9d66cc7ef5fd1 2023-11-25 12:54:56,866 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311250979d7564ed140059f0f94966c66c5ea to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311250979d7564ed140059f0f94966c66c5ea 2023-11-25 12:54:56,867 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family2/989ea3407e3e482ea311244936a911e7 2023-11-25 12:54:56,871 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family1/9aea3ef5e85b48beb6d198de95dc2e9d as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/9aea3ef5e85b48beb6d198de95dc2e9d 2023-11-25 12:54:56,871 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family2/527a6b3539da400199c0149e8751990d 2023-11-25 12:54:56,872 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family2/40faa7648fc64badaaa8d4416eb12d13 2023-11-25 12:54:56,875 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/9aea3ef5e85b48beb6d198de95dc2e9d, entries=4, sequenceid=9, filesize=5.4 K 2023-11-25 12:54:56,875 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family1/471575781e8a4ed1bfd7cb92ac6782f1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/471575781e8a4ed1bfd7cb92ac6782f1 2023-11-25 12:54:56,876 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family2/989ea3407e3e482ea311244936a911e7 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/989ea3407e3e482ea311244936a911e7 2023-11-25 12:54:56,877 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family1/0484872de8294cbd8239c4b9cdaa8a93 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/0484872de8294cbd8239c4b9cdaa8a93 2023-11-25 12:54:56,880 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/471575781e8a4ed1bfd7cb92ac6782f1, entries=4, sequenceid=9, filesize=5.4 K 2023-11-25 12:54:56,880 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/989ea3407e3e482ea311244936a911e7, entries=2, sequenceid=9, filesize=5.1 K 2023-11-25 12:54:56,881 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/0484872de8294cbd8239c4b9cdaa8a93, entries=4, sequenceid=9, filesize=5.4 K 2023-11-25 12:54:56,881 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family2/527a6b3539da400199c0149e8751990d as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/527a6b3539da400199c0149e8751990d 2023-11-25 12:54:56,882 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 83bb1fd938e2dac427ea10eb612df94b in 866ms, sequenceid=9, compaction requested=false 2023-11-25 12:54:56,882 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:54:56,882 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:54:56,882 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:54:56,884 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family2/40faa7648fc64badaaa8d4416eb12d13 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/40faa7648fc64badaaa8d4416eb12d13 2023-11-25 12:54:56,888 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/527a6b3539da400199c0149e8751990d, entries=2, sequenceid=9, filesize=5.1 K 2023-11-25 12:54:56,888 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/40faa7648fc64badaaa8d4416eb12d13, entries=2, sequenceid=9, filesize=5.1 K 2023-11-25 12:54:56,888 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 67ff462843156320a06b388981969e08 in 868ms, sequenceid=9, compaction requested=false 2023-11-25 12:54:56,888 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:54:56,888 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:54:56,888 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:54:56,888 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b003b003481e082b6bae5bad39b1e617 in 872ms, sequenceid=9, compaction requested=false 2023-11-25 12:54:56,888 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:54:56,888 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:54:56,888 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:54:56,889 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:54:56,889 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,889 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-25 12:54:56,889 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-25 12:54:56,894 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:56,894 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:56,894 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:56,894 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:56,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:56,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:56,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-25 12:54:56,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ea56762[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:56,895 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-25 12:54:56,896 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:56,897 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:56,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:56,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:56,897 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-25 12:54:56,897 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-25 12:54:56,897 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:56,897 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,897 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:56,898 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-25 12:54:56,898 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,898 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:56,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:56,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:56,898 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-25 12:54:56,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:56,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:56,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:56,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:56,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:56,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:56,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-25 12:54:56,901 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-25 12:54:56,901 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:56,901 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:56,901 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-25 12:54:56,901 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:56,903 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:56,903 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:56,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:56,903 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:56,904 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:56,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:56,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:56,905 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:56,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:56,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,907 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,907 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:56,907 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:56,907 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:56,907 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:56,907 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:56,907 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:56,907 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:56,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:56,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-25 12:54:56,907 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:56,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-25 12:54:56,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:56,908 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:56,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:56,908 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:56,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:56,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:56,908 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:57,008 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:57,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:57,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:54:57,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:54:57,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:54:57,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:57,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:57,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-25 12:54:57,016 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-25 12:54:57,016 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:57,016 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-25 12:54:57,016 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-25 12:54:57,016 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:57,016 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:57,018 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:57,018 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:57,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:57,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:57,018 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:57,018 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:57,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:57,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:57,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:57,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:57,019 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-25 12:54:57,019 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-25 12:54:57,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-25 12:54:57,019 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-25 12:54:57,019 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:57,019 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-25 12:54:57,019 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:54:57,020 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. started... 2023-11-25 12:54:57,020 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:54:57,020 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b003b003481e082b6bae5bad39b1e617 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-25 12:54:57,020 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:54:57,020 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:57,020 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. started... 2023-11-25 12:54:57,020 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:54:57,020 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. started... 2023-11-25 12:54:57,020 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 83bb1fd938e2dac427ea10eb612df94b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-25 12:54:57,020 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 67ff462843156320a06b388981969e08 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-25 12:54:57,037 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125676cf40d7da34837a7c5dcf63b1f513b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125676cf40d7da34837a7c5dcf63b1f513b 2023-11-25 12:54:57,037 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125c3cc86452438448b8af572e0a0b78451 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231125c3cc86452438448b8af572e0a0b78451 2023-11-25 12:54:57,437 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311256f40d810d1e6487c95c8e8de18674aa5 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311256f40d810d1e6487c95c8e8de18674aa5 2023-11-25 12:54:57,448 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family1/246af697b1ed43e8b70b20ffe6a1b2a4 2023-11-25 12:54:57,451 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family1/b63312e19f6e4ef2ab5a7dac9ecdbcc6 2023-11-25 12:54:57,842 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family1/f4f3643f6ee74d76bd28b3bd8e7e7cd7 2023-11-25 12:54:57,862 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311254dc08bad61d94b07a422c073ea65537e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311254dc08bad61d94b07a422c073ea65537e 2023-11-25 12:54:57,864 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311256ede46a2eafe48e79c0318eca969f348 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311256ede46a2eafe48e79c0318eca969f348 2023-11-25 12:54:57,866 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family2/6c9b4e0294134ed49933d99c40c86d5d 2023-11-25 12:54:57,868 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family2/ed7c3e9141634382a3bff703fe6853db 2023-11-25 12:54:57,870 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family1/246af697b1ed43e8b70b20ffe6a1b2a4 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/246af697b1ed43e8b70b20ffe6a1b2a4 2023-11-25 12:54:57,872 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family1/b63312e19f6e4ef2ab5a7dac9ecdbcc6 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/b63312e19f6e4ef2ab5a7dac9ecdbcc6 2023-11-25 12:54:57,874 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/246af697b1ed43e8b70b20ffe6a1b2a4, entries=4, sequenceid=13, filesize=5.4 K 2023-11-25 12:54:57,875 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family2/6c9b4e0294134ed49933d99c40c86d5d as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/6c9b4e0294134ed49933d99c40c86d5d 2023-11-25 12:54:57,875 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/b63312e19f6e4ef2ab5a7dac9ecdbcc6, entries=4, sequenceid=13, filesize=5.4 K 2023-11-25 12:54:57,876 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family2/ed7c3e9141634382a3bff703fe6853db as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed7c3e9141634382a3bff703fe6853db 2023-11-25 12:54:57,879 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/6c9b4e0294134ed49933d99c40c86d5d, entries=2, sequenceid=13, filesize=5.1 K 2023-11-25 12:54:57,879 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed7c3e9141634382a3bff703fe6853db, entries=2, sequenceid=13, filesize=5.1 K 2023-11-25 12:54:57,880 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b003b003481e082b6bae5bad39b1e617 in 860ms, sequenceid=13, compaction requested=true 2023-11-25 12:54:57,880 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 67ff462843156320a06b388981969e08 in 860ms, sequenceid=13, compaction requested=true 2023-11-25 12:54:57,880 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:54:57,880 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:54:57,880 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:54:57,880 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:54:57,880 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:54:57,880 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:54:58,256 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311253889e34f0cf5432cb9f34d47a2e3a9c8 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311253889e34f0cf5432cb9f34d47a2e3a9c8 2023-11-25 12:54:58,314 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-25 12:54:58,664 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family2/6f625c396cb64b959f114cbe8bbb4b1b 2023-11-25 12:54:58,668 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family1/f4f3643f6ee74d76bd28b3bd8e7e7cd7 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/f4f3643f6ee74d76bd28b3bd8e7e7cd7 2023-11-25 12:54:58,672 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/f4f3643f6ee74d76bd28b3bd8e7e7cd7, entries=4, sequenceid=13, filesize=5.4 K 2023-11-25 12:54:58,672 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family2/6f625c396cb64b959f114cbe8bbb4b1b as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/6f625c396cb64b959f114cbe8bbb4b1b 2023-11-25 12:54:58,676 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/6f625c396cb64b959f114cbe8bbb4b1b, entries=2, sequenceid=13, filesize=5.1 K 2023-11-25 12:54:58,677 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 83bb1fd938e2dac427ea10eb612df94b in 1657ms, sequenceid=13, compaction requested=true 2023-11-25 12:54:58,677 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:54:58,677 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:54:58,677 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:54:58,677 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:54:58,677 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,677 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-25 12:54:58,677 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-25 12:54:58,679 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:58,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:58,679 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:58,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:58,679 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:58,679 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:54:58,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:58,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:58,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:58,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-25 12:54:58,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ff8d9de[Count = 0] remaining members to acquire global barrier 2023-11-25 12:54:58,680 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-25 12:54:58,681 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:58,682 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:58,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:58,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:58,683 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-25 12:54:58,683 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-25 12:54:58,683 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:54:58,683 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,683 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:54:58,684 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,684 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-25 12:54:58,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:58,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:58,684 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:58,684 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-25 12:54:58,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:58,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:58,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:58,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:58,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:58,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:54:58,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-25 12:54:58,686 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-25 12:54:58,686 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:54:58,686 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:54:58,686 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-25 12:54:58,686 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:54:58,688 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:58,688 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:58,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:58,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:58,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:54:58,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:54:58,688 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:58,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:58,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:54:58,688 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:58,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:58,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:58,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:58,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:54:58,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:58,689 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:54:58,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:54:58,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,692 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,692 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:58,692 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:58,692 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:58,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-25 12:54:58,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:54:58,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:58,692 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:54:58,692 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:54:58,692 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:58,692 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-25 12:54:58,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-25 12:54:58,692 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:58,692 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:54:58,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:54:58,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:54:58,692 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:54:58,692 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:58,792 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:54:58,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:54:58,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:54:58,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:54:58,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:54:58,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:54:58,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-25 12:54:58,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-25 12:54:58,799 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-25 12:54:58,799 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:58,799 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-25 12:54:58,800 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-25 12:54:58,800 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:58,800 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:58,802 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:54:58,802 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:54:58,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:54:58,802 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:54:58,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:58,802 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:54:58,803 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:54:58,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:54:58,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:54:58,803 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-25 12:54:58,803 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-25 12:54:58,803 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-25 12:54:58,803 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-25 12:54:58,803 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:54:58,803 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-25 12:54:58,804 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:54:58,804 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. started... 2023-11-25 12:54:58,804 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:54:58,804 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:54:58,804 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b003b003481e082b6bae5bad39b1e617 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-25 12:54:58,804 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:54:58,804 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. started... 2023-11-25 12:54:58,804 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:54:58,804 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. started... 2023-11-25 12:54:58,804 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 67ff462843156320a06b388981969e08 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-25 12:54:58,804 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 83bb1fd938e2dac427ea10eb612df94b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-25 12:54:58,827 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125ffba1b2181e744a1b948524ab5974b48 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231125ffba1b2181e744a1b948524ab5974b48 2023-11-25 12:54:58,832 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125f09311caa24a441bb4f40be97b74aafc to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125f09311caa24a441bb4f40be97b74aafc 2023-11-25 12:54:58,833 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family1/402caeedd9b94e568a24afc6a10746d3 2023-11-25 12:54:58,837 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family1/59dcba9e5a014d46b8790903fb043f04 2023-11-25 12:54:58,848 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112553e7605e90c9474389cc4cdb6537c8ea to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112553e7605e90c9474389cc4cdb6537c8ea 2023-11-25 12:54:58,853 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112581e3c5b68be848e28529bf3c92422466 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112581e3c5b68be848e28529bf3c92422466 2023-11-25 12:54:58,853 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family2/792afde68bc9441d9b19037d4f08eb1d 2023-11-25 12:54:58,857 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family1/402caeedd9b94e568a24afc6a10746d3 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/402caeedd9b94e568a24afc6a10746d3 2023-11-25 12:54:58,857 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family2/c6bc3e563e3043f68c114803466cb070 2023-11-25 12:54:58,861 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family1/59dcba9e5a014d46b8790903fb043f04 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/59dcba9e5a014d46b8790903fb043f04 2023-11-25 12:54:58,864 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/59dcba9e5a014d46b8790903fb043f04, entries=4, sequenceid=17, filesize=5.4 K 2023-11-25 12:54:58,864 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/402caeedd9b94e568a24afc6a10746d3, entries=4, sequenceid=17, filesize=5.4 K 2023-11-25 12:54:58,865 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family2/792afde68bc9441d9b19037d4f08eb1d as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/792afde68bc9441d9b19037d4f08eb1d 2023-11-25 12:54:58,865 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family2/c6bc3e563e3043f68c114803466cb070 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/c6bc3e563e3043f68c114803466cb070 2023-11-25 12:54:58,870 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/792afde68bc9441d9b19037d4f08eb1d, entries=2, sequenceid=17, filesize=5.1 K 2023-11-25 12:54:58,870 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/c6bc3e563e3043f68c114803466cb070, entries=2, sequenceid=17, filesize=5.1 K 2023-11-25 12:54:58,870 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b003b003481e082b6bae5bad39b1e617 in 66ms, sequenceid=17, compaction requested=true 2023-11-25 12:54:58,871 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:54:58,871 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:54:58,871 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 67ff462843156320a06b388981969e08 in 67ms, sequenceid=17, compaction requested=true 2023-11-25 12:54:58,871 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:54:58,871 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:54:58,871 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:54:58,871 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:54:59,226 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125948117bd53f14bc59d112fd67ccc25d8 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231125948117bd53f14bc59d112fd67ccc25d8 2023-11-25 12:54:59,633 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family1/09f9e484c4b8441385cac64dca4800f3 2023-11-25 12:55:00,050 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311251d903168a616471788976ceae63c8fbf to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311251d903168a616471788976ceae63c8fbf 2023-11-25 12:55:00,071 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-25 12:55:00,455 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family2/7e6eb2a8fe5744be9aa79224db3313df 2023-11-25 12:55:00,459 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family1/09f9e484c4b8441385cac64dca4800f3 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/09f9e484c4b8441385cac64dca4800f3 2023-11-25 12:55:00,463 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/09f9e484c4b8441385cac64dca4800f3, entries=4, sequenceid=17, filesize=5.4 K 2023-11-25 12:55:00,463 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family2/7e6eb2a8fe5744be9aa79224db3313df as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/7e6eb2a8fe5744be9aa79224db3313df 2023-11-25 12:55:00,467 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/7e6eb2a8fe5744be9aa79224db3313df, entries=2, sequenceid=17, filesize=5.1 K 2023-11-25 12:55:00,467 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 83bb1fd938e2dac427ea10eb612df94b in 1663ms, sequenceid=17, compaction requested=true 2023-11-25 12:55:00,468 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:55:00,468 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:00,468 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:55:00,468 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:55:00,468 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:00,468 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-25 12:55:00,468 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-25 12:55:00,470 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:00,470 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:00,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:00,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:00,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:00,470 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:00,470 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:00,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:00,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:00,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:55:00,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:00,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:00,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-25 12:55:00,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3963df9f[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:00,471 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-25 12:55:00,472 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:00,473 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:00,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:00,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:00,473 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-25 12:55:00,473 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-25 12:55:00,473 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:00,473 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:00,473 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:00,474 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-25 12:55:00,474 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:00,474 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:00,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:00,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:00,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:00,474 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-25 12:55:00,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:00,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:00,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:55:00,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:00,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:00,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:55:00,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:00,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:00,477 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-25 12:55:00,477 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:00,477 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:00,477 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-25 12:55:00,477 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:00,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-25 12:55:00,479 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:00,479 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:00,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:00,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:00,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:00,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:00,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:00,479 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:00,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:00,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:00,480 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:00,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:00,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:55:00,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:00,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:00,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:55:00,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:00,481 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:00,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:00,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:55:00,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:00,483 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:00,483 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:00,483 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:55:00,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:00,484 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:00,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:00,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-25 12:55:00,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:00,484 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:55:00,484 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:00,484 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:00,484 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:00,484 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:00,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:00,484 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:00,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:00,484 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:00,484 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:00,584 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:00,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:00,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-25 12:55:00,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700916900596 (current time:1700916900596). 2023-11-25 12:55:00,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-25 12:55:00,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] zookeeper.ReadOnlyZKClient(139): Connect 0x1f419a7c to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:55:00,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e89aef3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:55:00,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:55:00,614 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:55:00,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f419a7c to 127.0.0.1:63200 2023-11-25 12:55:00,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:55:00,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-25 12:55:00,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-25 12:55:00,629 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.hbase-snapshot, current working dir path: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.hbase-snapshot/.tmp/snaptb-1700916900586 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-25 12:55:00,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-25 12:55:00,637 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-25 12:55:00,637 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700917500637 2023-11-25 12:55:00,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-25 12:55:00,638 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1700916900586 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-25 12:55:00,639 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-25 12:55:00,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-25 12:55:00,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-11-25 12:55:00,641 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-25 12:55:00,642 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1700917500642 2023-11-25 12:55:00,643 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:00,643 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-25 12:55:00,743 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-25 12:55:00,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-25 12:55:00,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-25 12:55:00,748 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-25 12:55:00,948 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-25 12:55:00,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-25 12:55:00,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-25 12:55:00,949 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-25 12:55:01,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1700916900586 2023-11-25 12:55:01,049 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1700916900586' 2023-11-25 12:55:01,049 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-25 12:55:01,049 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1700916900586' starting 'acquire' 2023-11-25 12:55:01,049 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1700916900586', kicking off acquire phase on members. 2023-11-25 12:55:01,050 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700916900586 2023-11-25 12:55:01,050 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1700916900586 2023-11-25 12:55:01,051 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-25 12:55:01,051 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1700916900586/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-25 12:55:01,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-25 12:55:01,052 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1700916900586/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,052 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:01,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1700916900586 2023-11-25 12:55:01,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700916900586 2023-11-25 12:55:01,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-25 12:55:01,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1700916900586 2023-11-25 12:55:01,053 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1700916900586 from table testCompactionWithHFileLink type FLUSH 2023-11-25 12:55:01,055 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1700916900586 2023-11-25 12:55:01,055 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1700916900586' with timeout 300000ms 2023-11-25 12:55:01,055 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-25 12:55:01,055 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1700916900586' starting 'acquire' stage 2023-11-25 12:55:01,055 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1700916900586' locally acquired 2023-11-25 12:55:01,055 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (snaptb-1700916900586) in zk 2023-11-25 12:55:01,057 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1700916900586 2023-11-25 12:55:01,057 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700916900586/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1700916900586/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:01,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-25 12:55:01,057 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700916900586 2023-11-25 12:55:01,057 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1700916900586' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:01,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:01,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:01,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700916900586 2023-11-25 12:55:01,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:01,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'snaptb-1700916900586' on coordinator 2023-11-25 12:55:01,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1aa8ec98[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:01,059 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1700916900586' starting 'in-barrier' execution. 2023-11-25 12:55:01,059 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1700916900586 2023-11-25 12:55:01,061 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700916900586 2023-11-25 12:55:01,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1700916900586 2023-11-25 12:55:01,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1700916900586 2023-11-25 12:55:01,061 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700916900586/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,061 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:01,061 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1700916900586' received 'reached' from coordinator. 2023-11-25 12:55:01,062 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:55:01,062 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:01,062 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-25 12:55:01,062 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:55:01,062 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-25 12:55:01,062 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. started... 2023-11-25 12:55:01,062 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. started... 2023-11-25 12:55:01,062 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. started... 2023-11-25 12:55:01,062 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:55:01,062 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:55:01,063 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:55:01,063 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.' region-info for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,063 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.' region-info for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,063 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.' region-info for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,069 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-25 12:55:01,069 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-25 12:55:01,069 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-25 12:55:01,072 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/1704ad43983c480b94486ba126258b57, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/9aea3ef5e85b48beb6d198de95dc2e9d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/f4f3643f6ee74d76bd28b3bd8e7e7cd7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/09f9e484c4b8441385cac64dca4800f3] hfiles 2023-11-25 12:55:01,072 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/9a63db5e301740ed967c31caa1581f4c, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/0484872de8294cbd8239c4b9cdaa8a93, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/246af697b1ed43e8b70b20ffe6a1b2a4, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/402caeedd9b94e568a24afc6a10746d3] hfiles 2023-11-25 12:55:01,072 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/1704ad43983c480b94486ba126258b57 for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,072 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/07726c1afd6241899cd789707c62d600, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/471575781e8a4ed1bfd7cb92ac6782f1, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/b63312e19f6e4ef2ab5a7dac9ecdbcc6, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/59dcba9e5a014d46b8790903fb043f04] hfiles 2023-11-25 12:55:01,072 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/9a63db5e301740ed967c31caa1581f4c for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,072 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/07726c1afd6241899cd789707c62d600 for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,075 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/0484872de8294cbd8239c4b9cdaa8a93 for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,075 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/471575781e8a4ed1bfd7cb92ac6782f1 for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/246af697b1ed43e8b70b20ffe6a1b2a4 for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/b63312e19f6e4ef2ab5a7dac9ecdbcc6 for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,075 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/9aea3ef5e85b48beb6d198de95dc2e9d for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/59dcba9e5a014d46b8790903fb043f04 for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/402caeedd9b94e568a24afc6a10746d3 for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/f4f3643f6ee74d76bd28b3bd8e7e7cd7 for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/09f9e484c4b8441385cac64dca4800f3 for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/515ef8a66e28483d84c469f3c2d7599f, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/40faa7648fc64badaaa8d4416eb12d13, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/6c9b4e0294134ed49933d99c40c86d5d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/792afde68bc9441d9b19037d4f08eb1d] hfiles 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed5e90748066410499e8750ef2575697, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/527a6b3539da400199c0149e8751990d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed7c3e9141634382a3bff703fe6853db, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/c6bc3e563e3043f68c114803466cb070] hfiles 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/515ef8a66e28483d84c469f3c2d7599f for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/ae489c65d08a4d8cbc577a6328d55457, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/989ea3407e3e482ea311244936a911e7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/6f625c396cb64b959f114cbe8bbb4b1b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/7e6eb2a8fe5744be9aa79224db3313df] hfiles 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/40faa7648fc64badaaa8d4416eb12d13 for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/ae489c65d08a4d8cbc577a6328d55457 for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed5e90748066410499e8750ef2575697 for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/989ea3407e3e482ea311244936a911e7 for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/527a6b3539da400199c0149e8751990d for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/6c9b4e0294134ed49933d99c40c86d5d for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed7c3e9141634382a3bff703fe6853db for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/792afde68bc9441d9b19037d4f08eb1d for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/c6bc3e563e3043f68c114803466cb070 for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,076 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/6f625c396cb64b959f114cbe8bbb4b1b for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,077 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/7e6eb2a8fe5744be9aa79224db3313df for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,088 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. completed. 2023-11-25 12:55:01,089 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:55:01,089 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-25 12:55:01,249 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-25 12:55:01,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-25 12:55:01,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-25 12:55:01,251 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-25 12:55:01,483 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. completed. 2023-11-25 12:55:01,483 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:55:01,483 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-25 12:55:01,487 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. completed. 2023-11-25 12:55:01,487 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:01,487 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-25 12:55:01,487 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-25 12:55:01,487 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,487 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1700916900586' locally completed 2023-11-25 12:55:01,487 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1700916900586' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:01,489 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700916900586/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,489 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1700916900586' has notified controller of completion 2023-11-25 12:55:01,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1700916900586/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:01,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-25 12:55:01,489 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:01,489 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1700916900586' completed. 2023-11-25 12:55:01,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:01,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:01,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700916900586 2023-11-25 12:55:01,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:01,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700916900586 2023-11-25 12:55:01,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1700916900586' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:01,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'snaptb-1700916900586', counting down latch. Waiting for 0 more 2023-11-25 12:55:01,491 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1700916900586' execution completed 2023-11-25 12:55:01,491 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:01,491 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:01,491 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1700916900586 2023-11-25 12:55:01,491 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1700916900586including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-25 12:55:01,493 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700916900586 2023-11-25 12:55:01,493 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700916900586 2023-11-25 12:55:01,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1700916900586 2023-11-25 12:55:01,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1700916900586 2023-11-25 12:55:01,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:01,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-25 12:55:01,493 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-25 12:55:01,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700916900586 2023-11-25 12:55:01,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:01,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-25 12:55:01,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-25 12:55:01,494 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1700916900586/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700916900586 2023-11-25 12:55:01,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700916900586 2023-11-25 12:55:01,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:01,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700916900586 2023-11-25 12:55:01,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,495 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1700916900586/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:01,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700916900586 2023-11-25 12:55:01,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,498 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-25 12:55:01,498 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700916900586/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,498 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:01,498 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1700916900586 2023-11-25 12:55:01,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-25 12:55:01,498 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-25 12:55:01,498 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-25 12:55:01,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-25 12:55:01,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1700916900586 2023-11-25 12:55:01,498 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700916900586 2023-11-25 12:55:01,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-25 12:55:01,498 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700916900586 2023-11-25 12:55:01,498 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700916900586/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:01,498 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700916900586 2023-11-25 12:55:01,498 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700916900586 2023-11-25 12:55:01,498 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700916900586 2023-11-25 12:55:01,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-25 12:55:01,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-25 12:55:01,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311255d76cd16f19f43b195ed2271761207d6, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112578fbe71b92a84181b85ecbd9a0ee1d26, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231125c3cc86452438448b8af572e0a0b78451, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231125ffba1b2181e744a1b948524ab5974b48, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112546c57f4a81374d0bb97e16a0a03959ab, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311256f40d810d1e6487c95c8e8de18674aa5, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112571aad81045734d62be9ab3c0adf6307b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231125948117bd53f14bc59d112fd67ccc25d8, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125220526c40aec47bb854d07d1d573ac46, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125676cf40d7da34837a7c5dcf63b1f513b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125bca32b8c07b84895815709d9bd67ad79, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125f09311caa24a441bb4f40be97b74aafc] mob files 2023-11-25 12:55:01,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311255d76cd16f19f43b195ed2271761207d6 2023-11-25 12:55:01,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112578fbe71b92a84181b85ecbd9a0ee1d26 2023-11-25 12:55:01,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231125c3cc86452438448b8af572e0a0b78451 2023-11-25 12:55:01,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231125ffba1b2181e744a1b948524ab5974b48 2023-11-25 12:55:01,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112546c57f4a81374d0bb97e16a0a03959ab 2023-11-25 12:55:01,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311256f40d810d1e6487c95c8e8de18674aa5 2023-11-25 12:55:01,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112571aad81045734d62be9ab3c0adf6307b 2023-11-25 12:55:01,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231125948117bd53f14bc59d112fd67ccc25d8 2023-11-25 12:55:01,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125220526c40aec47bb854d07d1d573ac46 2023-11-25 12:55:01,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125676cf40d7da34837a7c5dcf63b1f513b 2023-11-25 12:55:01,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125bca32b8c07b84895815709d9bd67ad79 2023-11-25 12:55:01,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125f09311caa24a441bb4f40be97b74aafc 2023-11-25 12:55:01,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112528cca0c6a19e437aada9d66cc7ef5fd1, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311254dc08bad61d94b07a422c073ea65537e, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112553e7605e90c9474389cc4cdb6537c8ea, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231125b4c4ef09feba4e6796bff3cf7efe2d9c, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311251d903168a616471788976ceae63c8fbf, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231125248dcc4a1b8e41c68f984c6796aa4505, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311253889e34f0cf5432cb9f34d47a2e3a9c8, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231125d2adfd2beeb04831b4ace28295fffeb7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311250979d7564ed140059f0f94966c66c5ea, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311256ede46a2eafe48e79c0318eca969f348, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112581e3c5b68be848e28529bf3c92422466, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231125af43ed0690124f779550895faadcff20] mob files 2023-11-25 12:55:01,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112528cca0c6a19e437aada9d66cc7ef5fd1 2023-11-25 12:55:01,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311254dc08bad61d94b07a422c073ea65537e 2023-11-25 12:55:01,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112553e7605e90c9474389cc4cdb6537c8ea 2023-11-25 12:55:01,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231125b4c4ef09feba4e6796bff3cf7efe2d9c 2023-11-25 12:55:01,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311251d903168a616471788976ceae63c8fbf 2023-11-25 12:55:01,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231125248dcc4a1b8e41c68f984c6796aa4505 2023-11-25 12:55:01,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311253889e34f0cf5432cb9f34d47a2e3a9c8 2023-11-25 12:55:01,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231125d2adfd2beeb04831b4ace28295fffeb7 2023-11-25 12:55:01,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311250979d7564ed140059f0f94966c66c5ea 2023-11-25 12:55:01,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311256ede46a2eafe48e79c0318eca969f348 2023-11-25 12:55:01,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112581e3c5b68be848e28529bf3c92422466 2023-11-25 12:55:01,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231125af43ed0690124f779550895faadcff20 2023-11-25 12:55:01,751 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-25 12:55:01,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-25 12:55:01,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-25 12:55:01,752 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-25 12:55:01,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1700916900586 2023-11-25 12:55:01,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.hbase-snapshot/.tmp/snaptb-1700916900586 2023-11-25 12:55:02,365 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.hbase-snapshot/.tmp/snaptb-1700916900586 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.hbase-snapshot/snaptb-1700916900586 2023-11-25 12:55:02,366 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1700916900586 of table testCompactionWithHFileLink completed 2023-11-25 12:55:02,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.hbase-snapshot/.tmp/snaptb-1700916900586 2023-11-25 12:55:02,367 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.hbase-snapshot/.tmp/snaptb-1700916900586 2023-11-25 12:55:02,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1700916900586 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700916900638Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1700916901907 (+1269 ms)Consolidate snapshot: snaptb-1700916900586 at 1700916901907Loading Region manifests for snaptb-1700916900586 at 1700916901907Writing data manifest for snaptb-1700916900586 at 1700916901917 (+10 ms)Verifying snapshot: snaptb-1700916900586 at 1700916902325 (+408 ms)Snapshot snaptb-1700916900586 of table testCompactionWithHFileLink completed at 1700916902366 (+41 ms) 2023-11-25 12:55:02,369 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-25 12:55:02,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.7300 sec 2023-11-25 12:55:02,752 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-25 12:55:02,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-25 12:55:02,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-25 12:55:02,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:02,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:02,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-25 12:55:02,791 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-25 12:55:02,791 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:02,791 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-25 12:55:02,791 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-25 12:55:02,792 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:02,792 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:55:02,794 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:02,794 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:02,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:02,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:02,794 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:02,794 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:02,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:55:02,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:02,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:02,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:55:02,795 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-25 12:55:02,796 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-25 12:55:02,796 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-25 12:55:02,796 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-25 12:55:02,796 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:02,796 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-25 12:55:02,799 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:55:02,799 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. started... 2023-11-25 12:55:02,799 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:02,799 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b003b003481e082b6bae5bad39b1e617 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-25 12:55:02,799 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:55:02,799 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:02,799 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:55:02,799 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. started... 2023-11-25 12:55:02,799 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. started... 2023-11-25 12:55:02,800 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 83bb1fd938e2dac427ea10eb612df94b 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-25 12:55:02,800 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 67ff462843156320a06b388981969e08 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-25 12:55:03,228 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family1/1ecefb4983f8464f8ea53610359da563 2023-11-25 12:55:03,231 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ecefb4983f8464f8ea53610359da563 2023-11-25 12:55:03,234 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family1/99c482b2f1cd441c92075ac3af087d68 2023-11-25 12:55:03,237 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99c482b2f1cd441c92075ac3af087d68 2023-11-25 12:55:03,629 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family1/2ea637e06edd4391a7b1dfcb5518573e 2023-11-25 12:55:03,632 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ea637e06edd4391a7b1dfcb5518573e 2023-11-25 12:55:04,042 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family2/1bddd505e2a6417080b7a2aa276e840b 2023-11-25 12:55:04,046 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1bddd505e2a6417080b7a2aa276e840b 2023-11-25 12:55:04,047 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family1/1ecefb4983f8464f8ea53610359da563 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/1ecefb4983f8464f8ea53610359da563 2023-11-25 12:55:04,048 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family2/7aa1839fcb79422fad162da8aa85082e 2023-11-25 12:55:04,051 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ecefb4983f8464f8ea53610359da563 2023-11-25 12:55:04,051 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/1ecefb4983f8464f8ea53610359da563, entries=3, sequenceid=24, filesize=5.0 K 2023-11-25 12:55:04,052 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7aa1839fcb79422fad162da8aa85082e 2023-11-25 12:55:04,052 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family2/1bddd505e2a6417080b7a2aa276e840b as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/1bddd505e2a6417080b7a2aa276e840b 2023-11-25 12:55:04,052 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family1/99c482b2f1cd441c92075ac3af087d68 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/99c482b2f1cd441c92075ac3af087d68 2023-11-25 12:55:04,056 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1bddd505e2a6417080b7a2aa276e840b 2023-11-25 12:55:04,056 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/1bddd505e2a6417080b7a2aa276e840b, entries=1, sequenceid=24, filesize=5.0 K 2023-11-25 12:55:04,056 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99c482b2f1cd441c92075ac3af087d68 2023-11-25 12:55:04,056 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/99c482b2f1cd441c92075ac3af087d68, entries=3, sequenceid=24, filesize=5.0 K 2023-11-25 12:55:04,057 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b003b003481e082b6bae5bad39b1e617 in 1258ms, sequenceid=24, compaction requested=true 2023-11-25 12:55:04,057 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:55:04,057 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:55:04,057 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:55:04,057 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family2/7aa1839fcb79422fad162da8aa85082e as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/7aa1839fcb79422fad162da8aa85082e 2023-11-25 12:55:04,060 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7aa1839fcb79422fad162da8aa85082e 2023-11-25 12:55:04,061 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/7aa1839fcb79422fad162da8aa85082e, entries=1, sequenceid=24, filesize=5.0 K 2023-11-25 12:55:04,061 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 83bb1fd938e2dac427ea10eb612df94b in 1261ms, sequenceid=24, compaction requested=true 2023-11-25 12:55:04,061 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:55:04,061 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:04,061 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:55:04,445 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family2/b4d0150dd9c741128b5ec38cec3804d8 2023-11-25 12:55:04,450 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4d0150dd9c741128b5ec38cec3804d8 2023-11-25 12:55:04,451 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family1/2ea637e06edd4391a7b1dfcb5518573e as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/2ea637e06edd4391a7b1dfcb5518573e 2023-11-25 12:55:04,454 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ea637e06edd4391a7b1dfcb5518573e 2023-11-25 12:55:04,455 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/2ea637e06edd4391a7b1dfcb5518573e, entries=3, sequenceid=24, filesize=5.0 K 2023-11-25 12:55:04,455 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family2/b4d0150dd9c741128b5ec38cec3804d8 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/b4d0150dd9c741128b5ec38cec3804d8 2023-11-25 12:55:04,459 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4d0150dd9c741128b5ec38cec3804d8 2023-11-25 12:55:04,459 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/b4d0150dd9c741128b5ec38cec3804d8, entries=1, sequenceid=24, filesize=5.0 K 2023-11-25 12:55:04,460 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 67ff462843156320a06b388981969e08 in 1660ms, sequenceid=24, compaction requested=true 2023-11-25 12:55:04,460 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:55:04,460 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:55:04,460 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:55:04,460 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:55:04,460 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:04,460 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-25 12:55:04,460 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-25 12:55:04,462 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:04,462 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:04,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:04,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:04,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:04,463 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:04,463 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:04,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:04,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:04,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:55:04,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:04,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:04,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-25 12:55:04,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ff306d8[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:04,464 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-25 12:55:04,464 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:04,465 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:04,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:04,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:04,465 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-25 12:55:04,465 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-25 12:55:04,465 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:04,466 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:04,466 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:04,467 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:04,467 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-25 12:55:04,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:04,467 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:04,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:04,467 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-25 12:55:04,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:04,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:04,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:04,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:55:04,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:04,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:04,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:55:04,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:04,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:04,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-25 12:55:04,470 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-25 12:55:04,470 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:04,470 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:04,470 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-25 12:55:04,470 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:04,473 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:04,473 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:04,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:04,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:04,473 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:04,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:04,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:04,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:04,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:04,474 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:04,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:04,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:04,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:04,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:55:04,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:04,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:55:04,475 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:04,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:04,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:04,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-25 12:55:04,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:04,477 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:04,477 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:04,477 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:55:04,477 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:04,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-25 12:55:04,477 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-25 12:55:04,477 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:04,477 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:04,477 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:04,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:04,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:04,477 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-25 12:55:04,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-25 12:55:04,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:04,477 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-25 12:55:04,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:04,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:04,478 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:04,478 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:04,578 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:04,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:04,580 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:55:04,580 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): b003b003481e082b6bae5bad39b1e617/family1 is initiating major compaction (all files) 2023-11-25 12:55:04,580 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:55:04,580 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:55:04,580 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of b003b003481e082b6bae5bad39b1e617/family1 in testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:55:04,580 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/9a63db5e301740ed967c31caa1581f4c, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/0484872de8294cbd8239c4b9cdaa8a93, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/246af697b1ed43e8b70b20ffe6a1b2a4, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/402caeedd9b94e568a24afc6a10746d3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/1ecefb4983f8464f8ea53610359da563] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp, totalSize=26.7 K 2023-11-25 12:55:04,581 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 9a63db5e301740ed967c31caa1581f4c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916894210 2023-11-25 12:55:04,581 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 0484872de8294cbd8239c4b9cdaa8a93, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916896007 2023-11-25 12:55:04,582 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 246af697b1ed43e8b70b20ffe6a1b2a4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916897011 2023-11-25 12:55:04,582 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 402caeedd9b94e568a24afc6a10746d3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916898795 2023-11-25 12:55:04,582 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 1ecefb4983f8464f8ea53610359da563, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-25 12:55:04,597 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): b003b003481e082b6bae5bad39b1e617#family1#compaction#106 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:55:05,006 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231125a094ef0752ac4a4f92b3f2c003baf73e_del 2023-11-25 12:55:05,006 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125a094ef0752ac4a4f92b3f2c003baf73e_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231125a094ef0752ac4a4f92b3f2c003baf73e_del 2023-11-25 12:55:05,574 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-25 12:55:05,821 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f0f82730eaf477d8980838f86e84bcc 2023-11-25 12:55:05,822 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family1/3f0f82730eaf477d8980838f86e84bcc as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/3f0f82730eaf477d8980838f86e84bcc 2023-11-25 12:55:05,826 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f0f82730eaf477d8980838f86e84bcc 2023-11-25 12:55:05,827 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b003b003481e082b6bae5bad39b1e617/family1 of b003b003481e082b6bae5bad39b1e617 into 3f0f82730eaf477d8980838f86e84bcc(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:55:05,827 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:55:05,827 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:55:05,827 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): b003b003481e082b6bae5bad39b1e617/family2 is initiating major compaction (all files) 2023-11-25 12:55:05,827 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:55:05,828 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:55:05,828 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of b003b003481e082b6bae5bad39b1e617/family2 in testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:55:05,828 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/515ef8a66e28483d84c469f3c2d7599f, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/40faa7648fc64badaaa8d4416eb12d13, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/6c9b4e0294134ed49933d99c40c86d5d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/792afde68bc9441d9b19037d4f08eb1d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/1bddd505e2a6417080b7a2aa276e840b] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp, totalSize=25.4 K 2023-11-25 12:55:05,828 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 515ef8a66e28483d84c469f3c2d7599f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916894210 2023-11-25 12:55:05,829 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 40faa7648fc64badaaa8d4416eb12d13, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916896007 2023-11-25 12:55:05,829 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 6c9b4e0294134ed49933d99c40c86d5d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916897011 2023-11-25 12:55:05,830 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 792afde68bc9441d9b19037d4f08eb1d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916898795 2023-11-25 12:55:05,830 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 1bddd505e2a6417080b7a2aa276e840b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-25 12:55:05,841 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): b003b003481e082b6bae5bad39b1e617#family2#compaction#107 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:55:05,916 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/9a63db5e301740ed967c31caa1581f4c, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/0484872de8294cbd8239c4b9cdaa8a93, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/246af697b1ed43e8b70b20ffe6a1b2a4, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/402caeedd9b94e568a24afc6a10746d3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/1ecefb4983f8464f8ea53610359da563] to archive 2023-11-25 12:55:05,917 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:05,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/9a63db5e301740ed967c31caa1581f4c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/9a63db5e301740ed967c31caa1581f4c 2023-11-25 12:55:05,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/0484872de8294cbd8239c4b9cdaa8a93 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/0484872de8294cbd8239c4b9cdaa8a93 2023-11-25 12:55:05,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/246af697b1ed43e8b70b20ffe6a1b2a4 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/246af697b1ed43e8b70b20ffe6a1b2a4 2023-11-25 12:55:05,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/402caeedd9b94e568a24afc6a10746d3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/402caeedd9b94e568a24afc6a10746d3 2023-11-25 12:55:05,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/1ecefb4983f8464f8ea53610359da563 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/1ecefb4983f8464f8ea53610359da563 2023-11-25 12:55:06,251 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231125b82372fabaa04a18a40b522b4c1e58cb_del 2023-11-25 12:55:06,251 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125b82372fabaa04a18a40b522b4c1e58cb_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231125b82372fabaa04a18a40b522b4c1e58cb_del 2023-11-25 12:55:07,064 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7929bdeb70174060a7add2352829afb6 2023-11-25 12:55:07,065 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family2/7929bdeb70174060a7add2352829afb6 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/7929bdeb70174060a7add2352829afb6 2023-11-25 12:55:07,069 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7929bdeb70174060a7add2352829afb6 2023-11-25 12:55:07,070 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b003b003481e082b6bae5bad39b1e617/family2 of b003b003481e082b6bae5bad39b1e617 into 7929bdeb70174060a7add2352829afb6(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:55:07,070 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:55:07,070 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:55:07,070 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): 83bb1fd938e2dac427ea10eb612df94b/family1 is initiating major compaction (all files) 2023-11-25 12:55:07,070 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:55:07,070 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:55:07,071 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of 83bb1fd938e2dac427ea10eb612df94b/family1 in testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:07,071 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/1704ad43983c480b94486ba126258b57, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/9aea3ef5e85b48beb6d198de95dc2e9d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/f4f3643f6ee74d76bd28b3bd8e7e7cd7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/09f9e484c4b8441385cac64dca4800f3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/99c482b2f1cd441c92075ac3af087d68] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp, totalSize=26.7 K 2023-11-25 12:55:07,072 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 1704ad43983c480b94486ba126258b57, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916894211 2023-11-25 12:55:07,072 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 9aea3ef5e85b48beb6d198de95dc2e9d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916896007 2023-11-25 12:55:07,072 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting f4f3643f6ee74d76bd28b3bd8e7e7cd7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916897011 2023-11-25 12:55:07,073 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 09f9e484c4b8441385cac64dca4800f3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916898795 2023-11-25 12:55:07,073 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 99c482b2f1cd441c92075ac3af087d68, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-25 12:55:07,083 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): 83bb1fd938e2dac427ea10eb612df94b#family1#compaction#108 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:55:07,113 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/515ef8a66e28483d84c469f3c2d7599f, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/40faa7648fc64badaaa8d4416eb12d13, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/6c9b4e0294134ed49933d99c40c86d5d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/792afde68bc9441d9b19037d4f08eb1d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/1bddd505e2a6417080b7a2aa276e840b] to archive 2023-11-25 12:55:07,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:07,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/515ef8a66e28483d84c469f3c2d7599f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/515ef8a66e28483d84c469f3c2d7599f 2023-11-25 12:55:07,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/40faa7648fc64badaaa8d4416eb12d13 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/40faa7648fc64badaaa8d4416eb12d13 2023-11-25 12:55:07,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/6c9b4e0294134ed49933d99c40c86d5d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/6c9b4e0294134ed49933d99c40c86d5d 2023-11-25 12:55:07,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/792afde68bc9441d9b19037d4f08eb1d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/792afde68bc9441d9b19037d4f08eb1d 2023-11-25 12:55:07,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/1bddd505e2a6417080b7a2aa276e840b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/1bddd505e2a6417080b7a2aa276e840b 2023-11-25 12:55:07,491 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231125662c1c2ff3614d34a63a5e6c642f5399_del 2023-11-25 12:55:07,491 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125662c1c2ff3614d34a63a5e6c642f5399_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231125662c1c2ff3614d34a63a5e6c642f5399_del 2023-11-25 12:55:08,306 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for facfb25fe00f47f280dbcf761e4a5490 2023-11-25 12:55:08,306 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family1/facfb25fe00f47f280dbcf761e4a5490 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/facfb25fe00f47f280dbcf761e4a5490 2023-11-25 12:55:08,310 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for facfb25fe00f47f280dbcf761e4a5490 2023-11-25 12:55:08,311 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 83bb1fd938e2dac427ea10eb612df94b/family1 of 83bb1fd938e2dac427ea10eb612df94b into facfb25fe00f47f280dbcf761e4a5490(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:55:08,312 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:55:08,312 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:55:08,312 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): 83bb1fd938e2dac427ea10eb612df94b/family2 is initiating major compaction (all files) 2023-11-25 12:55:08,312 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:55:08,312 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:55:08,312 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of 83bb1fd938e2dac427ea10eb612df94b/family2 in testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:08,312 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/ae489c65d08a4d8cbc577a6328d55457, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/989ea3407e3e482ea311244936a911e7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/6f625c396cb64b959f114cbe8bbb4b1b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/7e6eb2a8fe5744be9aa79224db3313df, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/7aa1839fcb79422fad162da8aa85082e] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp, totalSize=25.4 K 2023-11-25 12:55:08,313 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting ae489c65d08a4d8cbc577a6328d55457, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916894211 2023-11-25 12:55:08,313 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 989ea3407e3e482ea311244936a911e7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916896007 2023-11-25 12:55:08,313 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 6f625c396cb64b959f114cbe8bbb4b1b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916897011 2023-11-25 12:55:08,314 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 7e6eb2a8fe5744be9aa79224db3313df, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916898795 2023-11-25 12:55:08,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/1704ad43983c480b94486ba126258b57, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/9aea3ef5e85b48beb6d198de95dc2e9d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/f4f3643f6ee74d76bd28b3bd8e7e7cd7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/09f9e484c4b8441385cac64dca4800f3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/99c482b2f1cd441c92075ac3af087d68] to archive 2023-11-25 12:55:08,314 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 7aa1839fcb79422fad162da8aa85082e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-25 12:55:08,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:08,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/1704ad43983c480b94486ba126258b57 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/1704ad43983c480b94486ba126258b57 2023-11-25 12:55:08,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/9aea3ef5e85b48beb6d198de95dc2e9d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/9aea3ef5e85b48beb6d198de95dc2e9d 2023-11-25 12:55:08,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/f4f3643f6ee74d76bd28b3bd8e7e7cd7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/f4f3643f6ee74d76bd28b3bd8e7e7cd7 2023-11-25 12:55:08,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/09f9e484c4b8441385cac64dca4800f3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/09f9e484c4b8441385cac64dca4800f3 2023-11-25 12:55:08,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/99c482b2f1cd441c92075ac3af087d68 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/99c482b2f1cd441c92075ac3af087d68 2023-11-25 12:55:08,326 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): 83bb1fd938e2dac427ea10eb612df94b#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:55:08,737 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311256338456a4afa4a9da27842cc6518bec6_del 2023-11-25 12:55:08,738 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311256338456a4afa4a9da27842cc6518bec6_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311256338456a4afa4a9da27842cc6518bec6_del 2023-11-25 12:55:09,552 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74427f9a6f7d43a89b9a2fd3862d5763 2023-11-25 12:55:09,553 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family2/74427f9a6f7d43a89b9a2fd3862d5763 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/74427f9a6f7d43a89b9a2fd3862d5763 2023-11-25 12:55:09,556 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74427f9a6f7d43a89b9a2fd3862d5763 2023-11-25 12:55:09,557 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 83bb1fd938e2dac427ea10eb612df94b/family2 of 83bb1fd938e2dac427ea10eb612df94b into 74427f9a6f7d43a89b9a2fd3862d5763(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:55:09,557 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:55:09,557 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:55:09,557 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): 67ff462843156320a06b388981969e08/family1 is initiating major compaction (all files) 2023-11-25 12:55:09,557 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:55:09,557 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:55:09,558 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of 67ff462843156320a06b388981969e08/family1 in testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:55:09,558 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/07726c1afd6241899cd789707c62d600, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/471575781e8a4ed1bfd7cb92ac6782f1, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/b63312e19f6e4ef2ab5a7dac9ecdbcc6, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/59dcba9e5a014d46b8790903fb043f04, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/2ea637e06edd4391a7b1dfcb5518573e] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp, totalSize=26.7 K 2023-11-25 12:55:09,559 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 07726c1afd6241899cd789707c62d600, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916894208 2023-11-25 12:55:09,559 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 471575781e8a4ed1bfd7cb92ac6782f1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916896006 2023-11-25 12:55:09,559 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting b63312e19f6e4ef2ab5a7dac9ecdbcc6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916897011 2023-11-25 12:55:09,560 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 59dcba9e5a014d46b8790903fb043f04, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916898795 2023-11-25 12:55:09,560 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 2ea637e06edd4391a7b1dfcb5518573e, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-25 12:55:09,574 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): 67ff462843156320a06b388981969e08#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:55:09,615 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/ae489c65d08a4d8cbc577a6328d55457, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/989ea3407e3e482ea311244936a911e7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/6f625c396cb64b959f114cbe8bbb4b1b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/7e6eb2a8fe5744be9aa79224db3313df, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/7aa1839fcb79422fad162da8aa85082e] to archive 2023-11-25 12:55:09,616 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:09,618 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/ae489c65d08a4d8cbc577a6328d55457 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/ae489c65d08a4d8cbc577a6328d55457 2023-11-25 12:55:09,619 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/989ea3407e3e482ea311244936a911e7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/989ea3407e3e482ea311244936a911e7 2023-11-25 12:55:09,620 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/6f625c396cb64b959f114cbe8bbb4b1b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/6f625c396cb64b959f114cbe8bbb4b1b 2023-11-25 12:55:09,621 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/7e6eb2a8fe5744be9aa79224db3313df to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/7e6eb2a8fe5744be9aa79224db3313df 2023-11-25 12:55:09,622 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/7aa1839fcb79422fad162da8aa85082e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/7aa1839fcb79422fad162da8aa85082e 2023-11-25 12:55:09,985 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231125a7d51d7c4fec47c5a52aa55bd596a8b7_del 2023-11-25 12:55:09,985 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125a7d51d7c4fec47c5a52aa55bd596a8b7_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125a7d51d7c4fec47c5a52aa55bd596a8b7_del 2023-11-25 12:55:10,799 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 390339a710164b8480514dc38433c0cf 2023-11-25 12:55:10,800 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family1/390339a710164b8480514dc38433c0cf as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/390339a710164b8480514dc38433c0cf 2023-11-25 12:55:10,803 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 390339a710164b8480514dc38433c0cf 2023-11-25 12:55:10,804 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 67ff462843156320a06b388981969e08/family1 of 67ff462843156320a06b388981969e08 into 390339a710164b8480514dc38433c0cf(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:55:10,804 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:55:10,804 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:55:10,804 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): 67ff462843156320a06b388981969e08/family2 is initiating major compaction (all files) 2023-11-25 12:55:10,804 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:55:10,804 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:55:10,805 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of 67ff462843156320a06b388981969e08/family2 in testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:55:10,805 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed5e90748066410499e8750ef2575697, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/527a6b3539da400199c0149e8751990d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed7c3e9141634382a3bff703fe6853db, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/c6bc3e563e3043f68c114803466cb070, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/b4d0150dd9c741128b5ec38cec3804d8] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp, totalSize=25.4 K 2023-11-25 12:55:10,805 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting ed5e90748066410499e8750ef2575697, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916894208 2023-11-25 12:55:10,805 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 527a6b3539da400199c0149e8751990d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916896006 2023-11-25 12:55:10,806 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting ed7c3e9141634382a3bff703fe6853db, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916897011 2023-11-25 12:55:10,806 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting c6bc3e563e3043f68c114803466cb070, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916898795 2023-11-25 12:55:10,806 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting b4d0150dd9c741128b5ec38cec3804d8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-25 12:55:10,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/07726c1afd6241899cd789707c62d600, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/471575781e8a4ed1bfd7cb92ac6782f1, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/b63312e19f6e4ef2ab5a7dac9ecdbcc6, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/59dcba9e5a014d46b8790903fb043f04, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/2ea637e06edd4391a7b1dfcb5518573e] to archive 2023-11-25 12:55:10,814 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:10,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/07726c1afd6241899cd789707c62d600 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/07726c1afd6241899cd789707c62d600 2023-11-25 12:55:10,817 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): 67ff462843156320a06b388981969e08#family2#compaction#111 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:55:10,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/471575781e8a4ed1bfd7cb92ac6782f1 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/471575781e8a4ed1bfd7cb92ac6782f1 2023-11-25 12:55:10,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/b63312e19f6e4ef2ab5a7dac9ecdbcc6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/b63312e19f6e4ef2ab5a7dac9ecdbcc6 2023-11-25 12:55:10,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/59dcba9e5a014d46b8790903fb043f04 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/59dcba9e5a014d46b8790903fb043f04 2023-11-25 12:55:10,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/2ea637e06edd4391a7b1dfcb5518573e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/2ea637e06edd4391a7b1dfcb5518573e 2023-11-25 12:55:11,226 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231125e26e29af2b104f0f9c36168b905ebeee_del 2023-11-25 12:55:11,226 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125e26e29af2b104f0f9c36168b905ebeee_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231125e26e29af2b104f0f9c36168b905ebeee_del 2023-11-25 12:55:12,041 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b8281fa65504473af71541a3731d251 2023-11-25 12:55:12,042 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family2/7b8281fa65504473af71541a3731d251 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/7b8281fa65504473af71541a3731d251 2023-11-25 12:55:12,046 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b8281fa65504473af71541a3731d251 2023-11-25 12:55:12,047 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 67ff462843156320a06b388981969e08/family2 of 67ff462843156320a06b388981969e08 into 7b8281fa65504473af71541a3731d251(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:55:12,047 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:55:12,052 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:12,056 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:12,061 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:12,062 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:12,068 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-25 12:55:12,098 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-25 12:55:12,101 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231125a7d51d7c4fec47c5a52aa55bd596a8b7_del 2023-11-25 12:55:12,104 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231125a094ef0752ac4a4f92b3f2c003baf73e_del 2023-11-25 12:55:12,107 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231125662c1c2ff3614d34a63a5e6c642f5399_del 2023-11-25 12:55:12,107 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:12,108 DEBUG [Listener at localhost/45289] zookeeper.ReadOnlyZKClient(139): Connect 0x390d627a to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:55:12,112 DEBUG [Listener at localhost/45289] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3614c47e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:55:12,112 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231125 for table='testCompactionWithHFileLink' and column='family1' 2023-11-25 12:55:12,112 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231125 for table='testCompactionWithHFileLink' and column='family1' 2023-11-25 12:55:12,113 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231125 for table='testCompactionWithHFileLink' and column='family1' 2023-11-25 12:55:12,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed5e90748066410499e8750ef2575697, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/527a6b3539da400199c0149e8751990d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed7c3e9141634382a3bff703fe6853db, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/c6bc3e563e3043f68c114803466cb070, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/b4d0150dd9c741128b5ec38cec3804d8] to archive 2023-11-25 12:55:12,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:12,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed5e90748066410499e8750ef2575697 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed5e90748066410499e8750ef2575697 2023-11-25 12:55:12,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/527a6b3539da400199c0149e8751990d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/527a6b3539da400199c0149e8751990d 2023-11-25 12:55:12,122 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed7c3e9141634382a3bff703fe6853db to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/ed7c3e9141634382a3bff703fe6853db 2023-11-25 12:55:12,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/c6bc3e563e3043f68c114803466cb070 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/c6bc3e563e3043f68c114803466cb070 2023-11-25 12:55:12,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/b4d0150dd9c741128b5ec38cec3804d8 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/b4d0150dd9c741128b5ec38cec3804d8 2023-11-25 12:55:12,600 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112503b18d23d9df4b09b29ba93da49b096b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112503b18d23d9df4b09b29ba93da49b096b 2023-11-25 12:55:12,601 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231125 table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:12,613 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:55:12,616 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46068, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:55:12,622 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:55:12,624 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:55:12,632 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231125/family1/7772db8c02b445b08f376463c81b4fe9 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-25 12:55:12,632 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231125/family1/7772db8c02b445b08f376463c81b4fe9}] 2023-11-25 12:55:12,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231125/family1/7772db8c02b445b08f376463c81b4fe9 for inclusion in 67ff462843156320a06b388981969e08/family1 2023-11-25 12:55:12,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-25 12:55:12,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last=1 2023-11-25 12:55:12,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:55:12,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231125/family1/7772db8c02b445b08f376463c81b4fe9 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__cq01c9pj27hnuhob49pljgomqt0k79tlpg3eh9p11d6l0cbtc1264a08tp1ttupi/family1/7772db8c02b445b08f376463c81b4fe9 2023-11-25 12:55:12,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__cq01c9pj27hnuhob49pljgomqt0k79tlpg3eh9p11d6l0cbtc1264a08tp1ttupi/family1/7772db8c02b445b08f376463c81b4fe9 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/c7240b7390644cbea94cdb84ec524f50_SeqId_29_ 2023-11-25 12:55:12,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__cq01c9pj27hnuhob49pljgomqt0k79tlpg3eh9p11d6l0cbtc1264a08tp1ttupi/family1/7772db8c02b445b08f376463c81b4fe9 into 67ff462843156320a06b388981969e08/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/c7240b7390644cbea94cdb84ec524f50_SeqId_29_ - updating store file list. 2023-11-25 12:55:12,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/c7240b7390644cbea94cdb84ec524f50_SeqId_29_ into 67ff462843156320a06b388981969e08/family1 2023-11-25 12:55:12,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__cq01c9pj27hnuhob49pljgomqt0k79tlpg3eh9p11d6l0cbtc1264a08tp1ttupi/family1/7772db8c02b445b08f376463c81b4fe9 into 67ff462843156320a06b388981969e08/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/c7240b7390644cbea94cdb84ec524f50_SeqId_29_) 2023-11-25 12:55:12,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__cq01c9pj27hnuhob49pljgomqt0k79tlpg3eh9p11d6l0cbtc1264a08tp1ttupi/family1/7772db8c02b445b08f376463c81b4fe9 2023-11-25 12:55:12,650 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231125 table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:12,651 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:12,653 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125220526c40aec47bb854d07d1d573ac46 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125220526c40aec47bb854d07d1d573ac46 2023-11-25 12:55:12,654 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125676cf40d7da34837a7c5dcf63b1f513b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125676cf40d7da34837a7c5dcf63b1f513b 2023-11-25 12:55:12,655 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125bca32b8c07b84895815709d9bd67ad79 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125bca32b8c07b84895815709d9bd67ad79 2023-11-25 12:55:12,656 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125f09311caa24a441bb4f40be97b74aafc to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125f09311caa24a441bb4f40be97b74aafc 2023-11-25 12:55:12,656 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-25 12:55:12,656 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231125' 2023-11-25 12:55:12,657 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231125 for table='testCompactionWithHFileLink' and column='family1' 2023-11-25 12:55:13,001 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311257142b503ed4445a889059d41d3e4597f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311257142b503ed4445a889059d41d3e4597f 2023-11-25 12:55:13,001 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311259391b92cead14cb6b02fef4cdcebabbd to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311259391b92cead14cb6b02fef4cdcebabbd 2023-11-25 12:55:13,002 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231125 table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:13,002 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231125 table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:13,032 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231125/family1/c748180bb7524d4ba81ecad18d434c32 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-25 12:55:13,034 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231125/family1/c748180bb7524d4ba81ecad18d434c32}] 2023-11-25 12:55:13,035 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231125/family1/ca0e409b233443358fd1a333b2d7a518 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-25 12:55:13,035 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231125/family1/ca0e409b233443358fd1a333b2d7a518}] 2023-11-25 12:55:13,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231125/family1/c748180bb7524d4ba81ecad18d434c32 for inclusion in b003b003481e082b6bae5bad39b1e617/family1 2023-11-25 12:55:13,037 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231125/family1/ca0e409b233443358fd1a333b2d7a518 for inclusion in 83bb1fd938e2dac427ea10eb612df94b/family1 2023-11-25 12:55:13,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-25 12:55:13,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-25 12:55:13,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:55:13,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-25 12:55:13,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-25 12:55:13,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:55:13,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231125/family1/c748180bb7524d4ba81ecad18d434c32 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__gc7nc3bvd3kbi7qkes0o4lm87080j10ov2trshf407hd90q658lle959n4o2kbcg/family1/c748180bb7524d4ba81ecad18d434c32 2023-11-25 12:55:13,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231125/family1/ca0e409b233443358fd1a333b2d7a518 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__teght4faj173l4q4tpbcbfj0q7oe2qd17bnlj8rmk5r0mco4udhse0o91u0rsihe/family1/ca0e409b233443358fd1a333b2d7a518 2023-11-25 12:55:13,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__gc7nc3bvd3kbi7qkes0o4lm87080j10ov2trshf407hd90q658lle959n4o2kbcg/family1/c748180bb7524d4ba81ecad18d434c32 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/a6f6b0f14a6848988925a36ab2dd33ac_SeqId_29_ 2023-11-25 12:55:13,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__gc7nc3bvd3kbi7qkes0o4lm87080j10ov2trshf407hd90q658lle959n4o2kbcg/family1/c748180bb7524d4ba81ecad18d434c32 into b003b003481e082b6bae5bad39b1e617/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/a6f6b0f14a6848988925a36ab2dd33ac_SeqId_29_ - updating store file list. 2023-11-25 12:55:13,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__teght4faj173l4q4tpbcbfj0q7oe2qd17bnlj8rmk5r0mco4udhse0o91u0rsihe/family1/ca0e409b233443358fd1a333b2d7a518 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/33a49b2a06334acb897ff62dbd2a890b_SeqId_29_ 2023-11-25 12:55:13,048 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__teght4faj173l4q4tpbcbfj0q7oe2qd17bnlj8rmk5r0mco4udhse0o91u0rsihe/family1/ca0e409b233443358fd1a333b2d7a518 into 83bb1fd938e2dac427ea10eb612df94b/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/33a49b2a06334acb897ff62dbd2a890b_SeqId_29_ - updating store file list. 2023-11-25 12:55:13,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/a6f6b0f14a6848988925a36ab2dd33ac_SeqId_29_ into b003b003481e082b6bae5bad39b1e617/family1 2023-11-25 12:55:13,052 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/33a49b2a06334acb897ff62dbd2a890b_SeqId_29_ into 83bb1fd938e2dac427ea10eb612df94b/family1 2023-11-25 12:55:13,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__gc7nc3bvd3kbi7qkes0o4lm87080j10ov2trshf407hd90q658lle959n4o2kbcg/family1/c748180bb7524d4ba81ecad18d434c32 into b003b003481e082b6bae5bad39b1e617/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/a6f6b0f14a6848988925a36ab2dd33ac_SeqId_29_) 2023-11-25 12:55:13,052 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__teght4faj173l4q4tpbcbfj0q7oe2qd17bnlj8rmk5r0mco4udhse0o91u0rsihe/family1/ca0e409b233443358fd1a333b2d7a518 into 83bb1fd938e2dac427ea10eb612df94b/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/33a49b2a06334acb897ff62dbd2a890b_SeqId_29_) 2023-11-25 12:55:13,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__gc7nc3bvd3kbi7qkes0o4lm87080j10ov2trshf407hd90q658lle959n4o2kbcg/family1/c748180bb7524d4ba81ecad18d434c32 2023-11-25 12:55:13,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__teght4faj173l4q4tpbcbfj0q7oe2qd17bnlj8rmk5r0mco4udhse0o91u0rsihe/family1/ca0e409b233443358fd1a333b2d7a518 2023-11-25 12:55:13,054 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231125 table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:13,054 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231125 table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:13,055 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:13,055 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:13,056 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311255d76cd16f19f43b195ed2271761207d6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311255d76cd16f19f43b195ed2271761207d6 2023-11-25 12:55:13,056 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112546c57f4a81374d0bb97e16a0a03959ab to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112546c57f4a81374d0bb97e16a0a03959ab 2023-11-25 12:55:13,057 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112578fbe71b92a84181b85ecbd9a0ee1d26 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112578fbe71b92a84181b85ecbd9a0ee1d26 2023-11-25 12:55:13,057 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311256f40d810d1e6487c95c8e8de18674aa5 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311256f40d810d1e6487c95c8e8de18674aa5 2023-11-25 12:55:13,058 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231125c3cc86452438448b8af572e0a0b78451 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231125c3cc86452438448b8af572e0a0b78451 2023-11-25 12:55:13,059 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112571aad81045734d62be9ab3c0adf6307b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112571aad81045734d62be9ab3c0adf6307b 2023-11-25 12:55:13,059 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231125ffba1b2181e744a1b948524ab5974b48 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231125ffba1b2181e744a1b948524ab5974b48 2023-11-25 12:55:13,059 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-25 12:55:13,059 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231125' 2023-11-25 12:55:13,060 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231125948117bd53f14bc59d112fd67ccc25d8 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231125948117bd53f14bc59d112fd67ccc25d8 2023-11-25 12:55:13,060 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-25 12:55:13,060 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231125' 2023-11-25 12:55:13,060 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231125 for table='testCompactionWithHFileLink' and column='family1' 2023-11-25 12:55:13,060 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231125 for table='testCompactionWithHFileLink' and column='family1' 2023-11-25 12:55:13,060 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:13,060 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-25 12:55:13,060 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125a7d51d7c4fec47c5a52aa55bd596a8b7_del] 2023-11-25 12:55:13,061 DEBUG [Listener at localhost/45289] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:13,062 DEBUG [Listener at localhost/45289] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125a7d51d7c4fec47c5a52aa55bd596a8b7_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125a7d51d7c4fec47c5a52aa55bd596a8b7_del 2023-11-25 12:55:13,062 INFO [Listener at localhost/45289] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-25 12:55:13,062 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231125a094ef0752ac4a4f92b3f2c003baf73e_del] 2023-11-25 12:55:13,063 DEBUG [Listener at localhost/45289] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:13,064 DEBUG [Listener at localhost/45289] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231125a094ef0752ac4a4f92b3f2c003baf73e_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231125a094ef0752ac4a4f92b3f2c003baf73e_del 2023-11-25 12:55:13,064 INFO [Listener at localhost/45289] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-25 12:55:13,064 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231125662c1c2ff3614d34a63a5e6c642f5399_del] 2023-11-25 12:55:13,065 DEBUG [Listener at localhost/45289] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:13,066 DEBUG [Listener at localhost/45289] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231125662c1c2ff3614d34a63a5e6c642f5399_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231125662c1c2ff3614d34a63a5e6c642f5399_del 2023-11-25 12:55:13,066 INFO [Listener at localhost/45289] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-25 12:55:13,069 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:13,071 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:13,074 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:13,075 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:13,081 INFO [Listener at localhost/45289] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-25 12:55:13,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-11-25 12:55:13,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-25 12:55:13,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-25 12:55:13,086 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916913086"}]},"ts":"1700916913086"} 2023-11-25 12:55:13,087 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-25 12:55:13,089 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-25 12:55:13,089 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=67ff462843156320a06b388981969e08, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b003b003481e082b6bae5bad39b1e617, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=83bb1fd938e2dac427ea10eb612df94b, UNASSIGN}] 2023-11-25 12:55:13,091 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b003b003481e082b6bae5bad39b1e617, UNASSIGN 2023-11-25 12:55:13,091 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=83bb1fd938e2dac427ea10eb612df94b, UNASSIGN 2023-11-25 12:55:13,091 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=67ff462843156320a06b388981969e08, UNASSIGN 2023-11-25 12:55:13,091 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=b003b003481e082b6bae5bad39b1e617, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:13,091 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=83bb1fd938e2dac427ea10eb612df94b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:13,091 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=67ff462843156320a06b388981969e08, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:13,092 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700916913091"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916913091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916913091"}]},"ts":"1700916913091"} 2023-11-25 12:55:13,092 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916913091"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916913091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916913091"}]},"ts":"1700916913091"} 2023-11-25 12:55:13,092 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916913091"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916913091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916913091"}]},"ts":"1700916913091"} 2023-11-25 12:55:13,093 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=89, state=RUNNABLE; CloseRegionProcedure 67ff462843156320a06b388981969e08, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:55:13,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure b003b003481e082b6bae5bad39b1e617, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:55:13,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 83bb1fd938e2dac427ea10eb612df94b, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:55:13,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-25 12:55:13,244 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:13,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 67ff462843156320a06b388981969e08 2023-11-25 12:55:13,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 67ff462843156320a06b388981969e08, disabling compactions & flushes 2023-11-25 12:55:13,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:55:13,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:55:13,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. after waiting 0 ms 2023-11-25 12:55:13,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:55:13,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-25 12:55:13,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:55:13,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:55:13,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 67ff462843156320a06b388981969e08 2023-11-25 12:55:13,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:55:13,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 83bb1fd938e2dac427ea10eb612df94b, disabling compactions & flushes 2023-11-25 12:55:13,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:13,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:13,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. after waiting 0 ms 2023-11-25 12:55:13,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:13,254 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=67ff462843156320a06b388981969e08, regionState=CLOSED 2023-11-25 12:55:13,254 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916913254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916913254"}]},"ts":"1700916913254"} 2023-11-25 12:55:13,257 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=92, resume processing ppid=89 2023-11-25 12:55:13,257 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=89, state=SUCCESS; CloseRegionProcedure 67ff462843156320a06b388981969e08, server=jenkins-hbase4.apache.org,37051,1700916801082 in 162 msec 2023-11-25 12:55:13,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=67ff462843156320a06b388981969e08, UNASSIGN in 168 msec 2023-11-25 12:55:13,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-25 12:55:13,260 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:13,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:55:13,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:55:13,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b003b003481e082b6bae5bad39b1e617 2023-11-25 12:55:13,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b003b003481e082b6bae5bad39b1e617, disabling compactions & flushes 2023-11-25 12:55:13,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:55:13,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:55:13,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. after waiting 0 ms 2023-11-25 12:55:13,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:55:13,262 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=83bb1fd938e2dac427ea10eb612df94b, regionState=CLOSED 2023-11-25 12:55:13,262 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916913262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916913262"}]},"ts":"1700916913262"} 2023-11-25 12:55:13,265 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=94, resume processing ppid=91 2023-11-25 12:55:13,265 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 83bb1fd938e2dac427ea10eb612df94b, server=jenkins-hbase4.apache.org,37051,1700916801082 in 170 msec 2023-11-25 12:55:13,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=83bb1fd938e2dac427ea10eb612df94b, UNASSIGN in 176 msec 2023-11-25 12:55:13,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-25 12:55:13,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:55:13,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:55:13,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b003b003481e082b6bae5bad39b1e617 2023-11-25 12:55:13,274 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=b003b003481e082b6bae5bad39b1e617, regionState=CLOSED 2023-11-25 12:55:13,274 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700916913274"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916913274"}]},"ts":"1700916913274"} 2023-11-25 12:55:13,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=93, resume processing ppid=90 2023-11-25 12:55:13,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure b003b003481e082b6bae5bad39b1e617, server=jenkins-hbase4.apache.org,37051,1700916801082 in 183 msec 2023-11-25 12:55:13,278 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=90, resume processing ppid=88 2023-11-25 12:55:13,279 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b003b003481e082b6bae5bad39b1e617, UNASSIGN in 188 msec 2023-11-25 12:55:13,279 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916913279"}]},"ts":"1700916913279"} 2023-11-25 12:55:13,280 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-25 12:55:13,282 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-25 12:55:13,283 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 201 msec 2023-11-25 12:55:13,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-25 12:55:13,388 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-25 12:55:13,399 INFO [Listener at localhost/45289] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1700916900586-1700916913399 2023-11-25 12:55:13,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-25 12:55:13,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700916913400 (current time:1700916913400). 2023-11-25 12:55:13,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-25 12:55:13,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] zookeeper.ReadOnlyZKClient(139): Connect 0x7ba1bf74 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:55:13,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6049a8c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:55:13,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:55:13,411 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:55:13,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ba1bf74 to 127.0.0.1:63200 2023-11-25 12:55:13,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:55:13,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-25 12:55:13,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-25 12:55:13,415 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.hbase-snapshot, current working dir path: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700916900586-1700916913399 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-25 12:55:13,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-25 12:55:13,417 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-25 12:55:13,418 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700917513418 2023-11-25 12:55:13,418 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1700916900586-1700916913399 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-25 12:55:13,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-25 12:55:13,418 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:13,419 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-25 12:55:13,519 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-25 12:55:13,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-25 12:55:13,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-25 12:55:13,520 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-25 12:55:13,720 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-25 12:55:13,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-25 12:55:13,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-25 12:55:13,722 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-25 12:55:13,825 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-25 12:55:13,826 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-25 12:55:13,827 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-25 12:55:13,826 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-25 12:55:13,827 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-25 12:55:13,827 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-25 12:55:13,827 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-25 12:55:13,827 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-25 12:55:13,827 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-25 12:55:13,830 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/3f0f82730eaf477d8980838f86e84bcc, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/a6f6b0f14a6848988925a36ab2dd33ac_SeqId_29_] hfiles 2023-11-25 12:55:13,830 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/3f0f82730eaf477d8980838f86e84bcc 2023-11-25 12:55:13,830 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/a6f6b0f14a6848988925a36ab2dd33ac_SeqId_29_ 2023-11-25 12:55:13,830 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/33a49b2a06334acb897ff62dbd2a890b_SeqId_29_, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/facfb25fe00f47f280dbcf761e4a5490] hfiles 2023-11-25 12:55:13,830 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/390339a710164b8480514dc38433c0cf, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/c7240b7390644cbea94cdb84ec524f50_SeqId_29_] hfiles 2023-11-25 12:55:13,830 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/33a49b2a06334acb897ff62dbd2a890b_SeqId_29_ 2023-11-25 12:55:13,830 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/390339a710164b8480514dc38433c0cf 2023-11-25 12:55:13,830 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/facfb25fe00f47f280dbcf761e4a5490 2023-11-25 12:55:13,830 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/c7240b7390644cbea94cdb84ec524f50_SeqId_29_ 2023-11-25 12:55:13,830 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311257142b503ed4445a889059d41d3e4597f, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311259391b92cead14cb6b02fef4cdcebabbd, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112503b18d23d9df4b09b29ba93da49b096b] hfiles 2023-11-25 12:55:13,830 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311257142b503ed4445a889059d41d3e4597f 2023-11-25 12:55:13,830 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311259391b92cead14cb6b02fef4cdcebabbd 2023-11-25 12:55:13,830 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112503b18d23d9df4b09b29ba93da49b096b 2023-11-25 12:55:13,831 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/7929bdeb70174060a7add2352829afb6] hfiles 2023-11-25 12:55:13,831 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/74427f9a6f7d43a89b9a2fd3862d5763] hfiles 2023-11-25 12:55:13,831 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/7929bdeb70174060a7add2352829afb6 2023-11-25 12:55:13,831 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/74427f9a6f7d43a89b9a2fd3862d5763 2023-11-25 12:55:13,831 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/7b8281fa65504473af71541a3731d251] hfiles 2023-11-25 12:55:13,831 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/7b8281fa65504473af71541a3731d251 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112528cca0c6a19e437aada9d66cc7ef5fd1, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311254dc08bad61d94b07a422c073ea65537e, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112553e7605e90c9474389cc4cdb6537c8ea, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231125b4c4ef09feba4e6796bff3cf7efe2d9c, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231125b82372fabaa04a18a40b522b4c1e58cb_del, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311251d903168a616471788976ceae63c8fbf, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231125248dcc4a1b8e41c68f984c6796aa4505, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311253889e34f0cf5432cb9f34d47a2e3a9c8, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311256338456a4afa4a9da27842cc6518bec6_del, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231125d2adfd2beeb04831b4ace28295fffeb7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311250979d7564ed140059f0f94966c66c5ea, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311256ede46a2eafe48e79c0318eca969f348, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112581e3c5b68be848e28529bf3c92422466, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231125af43ed0690124f779550895faadcff20, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231125e26e29af2b104f0f9c36168b905ebeee_del] hfiles 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112528cca0c6a19e437aada9d66cc7ef5fd1 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311254dc08bad61d94b07a422c073ea65537e 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112553e7605e90c9474389cc4cdb6537c8ea 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231125b4c4ef09feba4e6796bff3cf7efe2d9c 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231125b82372fabaa04a18a40b522b4c1e58cb_del 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311251d903168a616471788976ceae63c8fbf 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231125248dcc4a1b8e41c68f984c6796aa4505 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311253889e34f0cf5432cb9f34d47a2e3a9c8 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311256338456a4afa4a9da27842cc6518bec6_del 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231125d2adfd2beeb04831b4ace28295fffeb7 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311250979d7564ed140059f0f94966c66c5ea 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311256ede46a2eafe48e79c0318eca969f348 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112581e3c5b68be848e28529bf3c92422466 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231125af43ed0690124f779550895faadcff20 2023-11-25 12:55:13,838 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231125e26e29af2b104f0f9c36168b905ebeee_del 2023-11-25 12:55:14,022 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-25 12:55:14,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-25 12:55:14,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-25 12:55:14,023 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-25 12:55:14,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-25 12:55:14,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1700916900586-1700916913399 2023-11-25 12:55:14,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700916900586-1700916913399 2023-11-25 12:55:14,523 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-25 12:55:14,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-25 12:55:14,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-25 12:55:14,524 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-25 12:55:14,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700916900586-1700916913399 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.hbase-snapshot/hbase-failsafe-snaptb-1700916900586-1700916913399 2023-11-25 12:55:14,671 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1700916900586-1700916913399 of table testCompactionWithHFileLink completed 2023-11-25 12:55:14,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700916900586-1700916913399 2023-11-25 12:55:14,672 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700916900586-1700916913399 2023-11-25 12:55:14,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1700916900586-1700916913399 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700916913418Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1700916913825 (+407 ms)Consolidate snapshot: hbase-failsafe-snaptb-1700916900586-1700916913399 at 1700916914243 (+418 ms)Loading Region manifests for hbase-failsafe-snaptb-1700916900586-1700916913399 at 1700916914243Writing data manifest for hbase-failsafe-snaptb-1700916900586-1700916913399 at 1700916914246 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1700916900586-1700916913399 at 1700916914652 (+406 ms)Snapshot hbase-failsafe-snaptb-1700916900586-1700916913399 of table testCompactionWithHFileLink completed at 1700916914671 (+19 ms) 2023-11-25 12:55:14,673 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-25 12:55:14,675 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2570 sec 2023-11-25 12:55:15,525 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-25 12:55:15,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-25 12:55:15,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1700916900586-1700916913399 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-25 12:55:15,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700916900586" table: "testCompactionWithHFileLink" creation_time: 1700916900596 type: FLUSH version: 2 ttl: 0 ) 2023-11-25 12:55:15,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1700916900586 as table=testCompactionWithHFileLink 2023-11-25 12:55:15,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-25 12:55:15,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-25 12:55:15,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-25 12:55:15,975 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-25 12:55:15,976 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-25 12:55:15,976 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-25 12:55:15,977 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-25 12:55:15,983 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1700916900586" table: "testCompactionWithHFileLink" creation_time: 1700916900596 type: FLUSH version: 2 ttl: 0 2023-11-25 12:55:15,983 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink 2023-11-25 12:55:15,988 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-25 12:55:15,992 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311259391b92cead14cb6b02fef4cdcebabbd to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311259391b92cead14cb6b02fef4cdcebabbd 2023-11-25 12:55:15,993 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112503b18d23d9df4b09b29ba93da49b096b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112503b18d23d9df4b09b29ba93da49b096b 2023-11-25 12:55:15,995 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311257142b503ed4445a889059d41d3e4597f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311257142b503ed4445a889059d41d3e4597f 2023-11-25 12:55:15,995 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311255d76cd16f19f43b195ed2271761207d6 of snapshot=snaptb-1700916900586 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-25 12:55:15,998 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023112578fbe71b92a84181b85ecbd9a0ee1d26 of snapshot=snaptb-1700916900586 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-25 12:55:16,002 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231125c3cc86452438448b8af572e0a0b78451 of snapshot=snaptb-1700916900586 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-25 12:55:16,005 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231125ffba1b2181e744a1b948524ab5974b48 of snapshot=snaptb-1700916900586 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-25 12:55:16,008 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023112546c57f4a81374d0bb97e16a0a03959ab of snapshot=snaptb-1700916900586 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-25 12:55:16,010 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311256f40d810d1e6487c95c8e8de18674aa5 of snapshot=snaptb-1700916900586 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-25 12:55:16,014 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023112571aad81045734d62be9ab3c0adf6307b of snapshot=snaptb-1700916900586 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-25 12:55:16,017 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231125948117bd53f14bc59d112fd67ccc25d8 of snapshot=snaptb-1700916900586 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-25 12:55:16,021 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231125220526c40aec47bb854d07d1d573ac46 of snapshot=snaptb-1700916900586 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-25 12:55:16,024 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231125676cf40d7da34837a7c5dcf63b1f513b of snapshot=snaptb-1700916900586 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-25 12:55:16,027 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231125bca32b8c07b84895815709d9bd67ad79 of snapshot=snaptb-1700916900586 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-25 12:55:16,030 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231125f09311caa24a441bb4f40be97b74aafc of snapshot=snaptb-1700916900586 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-25 12:55:16,038 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311256338456a4afa4a9da27842cc6518bec6_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311256338456a4afa4a9da27842cc6518bec6_del 2023-11-25 12:55:16,039 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231125e26e29af2b104f0f9c36168b905ebeee_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231125e26e29af2b104f0f9c36168b905ebeee_del 2023-11-25 12:55:16,041 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231125b82372fabaa04a18a40b522b4c1e58cb_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231125b82372fabaa04a18a40b522b4c1e58cb_del 2023-11-25 12:55:16,041 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 67ff462843156320a06b388981969e08 2023-11-25 12:55:16,041 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:55:16,041 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: b003b003481e082b6bae5bad39b1e617 2023-11-25 12:55:16,049 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/c7240b7390644cbea94cdb84ec524f50_SeqId_29_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/c7240b7390644cbea94cdb84ec524f50_SeqId_29_ 2023-11-25 12:55:16,049 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/3f0f82730eaf477d8980838f86e84bcc to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/3f0f82730eaf477d8980838f86e84bcc 2023-11-25 12:55:16,050 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/33a49b2a06334acb897ff62dbd2a890b_SeqId_29_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/33a49b2a06334acb897ff62dbd2a890b_SeqId_29_ 2023-11-25 12:55:16,051 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/390339a710164b8480514dc38433c0cf to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/390339a710164b8480514dc38433c0cf 2023-11-25 12:55:16,051 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 07726c1afd6241899cd789707c62d600 of snapshot=snaptb-1700916900586 to region=67ff462843156320a06b388981969e08 table=testCompactionWithHFileLink 2023-11-25 12:55:16,051 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/a6f6b0f14a6848988925a36ab2dd33ac_SeqId_29_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/a6f6b0f14a6848988925a36ab2dd33ac_SeqId_29_ 2023-11-25 12:55:16,051 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9a63db5e301740ed967c31caa1581f4c of snapshot=snaptb-1700916900586 to region=b003b003481e082b6bae5bad39b1e617 table=testCompactionWithHFileLink 2023-11-25 12:55:16,051 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/facfb25fe00f47f280dbcf761e4a5490 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/facfb25fe00f47f280dbcf761e4a5490 2023-11-25 12:55:16,051 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1704ad43983c480b94486ba126258b57 of snapshot=snaptb-1700916900586 to region=83bb1fd938e2dac427ea10eb612df94b table=testCompactionWithHFileLink 2023-11-25 12:55:16,057 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 471575781e8a4ed1bfd7cb92ac6782f1 of snapshot=snaptb-1700916900586 to region=67ff462843156320a06b388981969e08 table=testCompactionWithHFileLink 2023-11-25 12:55:16,057 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9aea3ef5e85b48beb6d198de95dc2e9d of snapshot=snaptb-1700916900586 to region=83bb1fd938e2dac427ea10eb612df94b table=testCompactionWithHFileLink 2023-11-25 12:55:16,057 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0484872de8294cbd8239c4b9cdaa8a93 of snapshot=snaptb-1700916900586 to region=b003b003481e082b6bae5bad39b1e617 table=testCompactionWithHFileLink 2023-11-25 12:55:16,064 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f4f3643f6ee74d76bd28b3bd8e7e7cd7 of snapshot=snaptb-1700916900586 to region=83bb1fd938e2dac427ea10eb612df94b table=testCompactionWithHFileLink 2023-11-25 12:55:16,064 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b63312e19f6e4ef2ab5a7dac9ecdbcc6 of snapshot=snaptb-1700916900586 to region=67ff462843156320a06b388981969e08 table=testCompactionWithHFileLink 2023-11-25 12:55:16,064 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 246af697b1ed43e8b70b20ffe6a1b2a4 of snapshot=snaptb-1700916900586 to region=b003b003481e082b6bae5bad39b1e617 table=testCompactionWithHFileLink 2023-11-25 12:55:16,068 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 09f9e484c4b8441385cac64dca4800f3 of snapshot=snaptb-1700916900586 to region=83bb1fd938e2dac427ea10eb612df94b table=testCompactionWithHFileLink 2023-11-25 12:55:16,068 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 402caeedd9b94e568a24afc6a10746d3 of snapshot=snaptb-1700916900586 to region=b003b003481e082b6bae5bad39b1e617 table=testCompactionWithHFileLink 2023-11-25 12:55:16,068 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 59dcba9e5a014d46b8790903fb043f04 of snapshot=snaptb-1700916900586 to region=67ff462843156320a06b388981969e08 table=testCompactionWithHFileLink 2023-11-25 12:55:16,074 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/74427f9a6f7d43a89b9a2fd3862d5763 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/74427f9a6f7d43a89b9a2fd3862d5763 2023-11-25 12:55:16,074 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ae489c65d08a4d8cbc577a6328d55457 of snapshot=snaptb-1700916900586 to region=83bb1fd938e2dac427ea10eb612df94b table=testCompactionWithHFileLink 2023-11-25 12:55:16,074 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/7929bdeb70174060a7add2352829afb6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/7929bdeb70174060a7add2352829afb6 2023-11-25 12:55:16,074 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 515ef8a66e28483d84c469f3c2d7599f of snapshot=snaptb-1700916900586 to region=b003b003481e082b6bae5bad39b1e617 table=testCompactionWithHFileLink 2023-11-25 12:55:16,075 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/7b8281fa65504473af71541a3731d251 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/7b8281fa65504473af71541a3731d251 2023-11-25 12:55:16,075 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ed5e90748066410499e8750ef2575697 of snapshot=snaptb-1700916900586 to region=67ff462843156320a06b388981969e08 table=testCompactionWithHFileLink 2023-11-25 12:55:16,086 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 989ea3407e3e482ea311244936a911e7 of snapshot=snaptb-1700916900586 to region=83bb1fd938e2dac427ea10eb612df94b table=testCompactionWithHFileLink 2023-11-25 12:55:16,086 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 40faa7648fc64badaaa8d4416eb12d13 of snapshot=snaptb-1700916900586 to region=b003b003481e082b6bae5bad39b1e617 table=testCompactionWithHFileLink 2023-11-25 12:55:16,086 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 527a6b3539da400199c0149e8751990d of snapshot=snaptb-1700916900586 to region=67ff462843156320a06b388981969e08 table=testCompactionWithHFileLink 2023-11-25 12:55:16,092 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6f625c396cb64b959f114cbe8bbb4b1b of snapshot=snaptb-1700916900586 to region=83bb1fd938e2dac427ea10eb612df94b table=testCompactionWithHFileLink 2023-11-25 12:55:16,092 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6c9b4e0294134ed49933d99c40c86d5d of snapshot=snaptb-1700916900586 to region=b003b003481e082b6bae5bad39b1e617 table=testCompactionWithHFileLink 2023-11-25 12:55:16,093 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ed7c3e9141634382a3bff703fe6853db of snapshot=snaptb-1700916900586 to region=67ff462843156320a06b388981969e08 table=testCompactionWithHFileLink 2023-11-25 12:55:16,096 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7e6eb2a8fe5744be9aa79224db3313df of snapshot=snaptb-1700916900586 to region=83bb1fd938e2dac427ea10eb612df94b table=testCompactionWithHFileLink 2023-11-25 12:55:16,097 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 792afde68bc9441d9b19037d4f08eb1d of snapshot=snaptb-1700916900586 to region=b003b003481e082b6bae5bad39b1e617 table=testCompactionWithHFileLink 2023-11-25 12:55:16,097 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c6bc3e563e3043f68c114803466cb070 of snapshot=snaptb-1700916900586 to region=67ff462843156320a06b388981969e08 table=testCompactionWithHFileLink 2023-11-25 12:55:16,100 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1700916900586" table: "testCompactionWithHFileLink" creation_time: 1700916900596 type: FLUSH version: 2 ttl: 0 2023-11-25 12:55:16,102 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700916916101"}]},"ts":"9223372036854775807"} 2023-11-25 12:55:16,102 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700916916101"}]},"ts":"9223372036854775807"} 2023-11-25 12:55:16,102 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700916916101"}]},"ts":"9223372036854775807"} 2023-11-25 12:55:16,103 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-25 12:55:16,104 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 67ff462843156320a06b388981969e08, NAME => 'testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 83bb1fd938e2dac427ea10eb612df94b, NAME => 'testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => b003b003481e082b6bae5bad39b1e617, NAME => 'testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.', STARTKEY => '1', ENDKEY => '2'}] 2023-11-25 12:55:16,104 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916916102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916916102"}]},"ts":"1700916916102"} 2023-11-25 12:55:16,104 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916916102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916916102"}]},"ts":"1700916916102"} 2023-11-25 12:55:16,104 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700916916102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916916102"}]},"ts":"1700916916102"} 2023-11-25 12:55:16,105 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-25 12:55:16,105 INFO [PEWorker-3] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-25 12:55:16,105 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 67ff462843156320a06b388981969e08, NAME => 'testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 83bb1fd938e2dac427ea10eb612df94b, NAME => 'testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => b003b003481e082b6bae5bad39b1e617, NAME => 'testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.', STARTKEY => '1', ENDKEY => '2'}] 2023-11-25 12:55:16,106 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1700916900586 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-25 12:55:16,107 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700916900586" table: "testCompactionWithHFileLink" creation_time: 1700916900596 type: FLUSH version: 2 ttl: 0 ) in 550 msec 2023-11-25 12:55:16,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-25 12:55:16,171 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-25 12:55:16,171 INFO [Listener at localhost/45289] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1700916900586-1700916913399 2023-11-25 12:55:16,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1700916900586-1700916913399" 2023-11-25 12:55:16,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1700916900586-1700916913399 2023-11-25 12:55:16,181 INFO [Listener at localhost/45289] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-25 12:55:16,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-11-25 12:55:16,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-25 12:55:16,196 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-25 12:55:16,196 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916916196"}]},"ts":"1700916916196"} 2023-11-25 12:55:16,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-25 12:55:16,197 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-25 12:55:16,200 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-25 12:55:16,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=67ff462843156320a06b388981969e08, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b003b003481e082b6bae5bad39b1e617, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=83bb1fd938e2dac427ea10eb612df94b, ASSIGN}] 2023-11-25 12:55:16,201 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=67ff462843156320a06b388981969e08, ASSIGN 2023-11-25 12:55:16,201 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=83bb1fd938e2dac427ea10eb612df94b, ASSIGN 2023-11-25 12:55:16,201 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b003b003481e082b6bae5bad39b1e617, ASSIGN 2023-11-25 12:55:16,202 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=83bb1fd938e2dac427ea10eb612df94b, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-25 12:55:16,202 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b003b003481e082b6bae5bad39b1e617, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-25 12:55:16,202 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=67ff462843156320a06b388981969e08, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-25 12:55:16,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-25 12:55:16,353 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=b003b003481e082b6bae5bad39b1e617, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:16,353 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=83bb1fd938e2dac427ea10eb612df94b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:16,353 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=67ff462843156320a06b388981969e08, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:16,354 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700916916353"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916916353"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916916353"}]},"ts":"1700916916353"} 2023-11-25 12:55:16,354 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916916353"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916916353"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916916353"}]},"ts":"1700916916353"} 2023-11-25 12:55:16,354 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916916353"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916916353"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916916353"}]},"ts":"1700916916353"} 2023-11-25 12:55:16,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure b003b003481e082b6bae5bad39b1e617, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:55:16,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure 67ff462843156320a06b388981969e08, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:55:16,357 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; OpenRegionProcedure 83bb1fd938e2dac427ea10eb612df94b, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:55:16,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-25 12:55:16,507 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:16,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:16,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 83bb1fd938e2dac427ea10eb612df94b, NAME => 'testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.', STARTKEY => '2', ENDKEY => ''} 2023-11-25 12:55:16,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:55:16,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:16,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:55:16,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:55:16,511 INFO [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:55:16,512 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1 2023-11-25 12:55:16,512 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1 2023-11-25 12:55:16,512 INFO [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83bb1fd938e2dac427ea10eb612df94b columnFamilyName family1 2023-11-25 12:55:16,521 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-09f9e484c4b8441385cac64dca4800f3 2023-11-25 12:55:16,526 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-1704ad43983c480b94486ba126258b57 2023-11-25 12:55:16,530 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-9aea3ef5e85b48beb6d198de95dc2e9d 2023-11-25 12:55:16,535 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-f4f3643f6ee74d76bd28b3bd8e7e7cd7 2023-11-25 12:55:16,535 INFO [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(310): Store=83bb1fd938e2dac427ea10eb612df94b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:16,535 INFO [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:55:16,536 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2 2023-11-25 12:55:16,536 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2 2023-11-25 12:55:16,536 INFO [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83bb1fd938e2dac427ea10eb612df94b columnFamilyName family2 2023-11-25 12:55:16,543 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-6f625c396cb64b959f114cbe8bbb4b1b 2023-11-25 12:55:16,547 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-7e6eb2a8fe5744be9aa79224db3313df 2023-11-25 12:55:16,552 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-989ea3407e3e482ea311244936a911e7 2023-11-25 12:55:16,557 DEBUG [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-ae489c65d08a4d8cbc577a6328d55457 2023-11-25 12:55:16,557 INFO [StoreOpener-83bb1fd938e2dac427ea10eb612df94b-1] regionserver.HStore(310): Store=83bb1fd938e2dac427ea10eb612df94b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:16,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:55:16,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:55:16,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-25 12:55:16,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:55:16,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 83bb1fd938e2dac427ea10eb612df94b; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62103887, jitterRate=-0.07457996904850006}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-25 12:55:16,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:55:16,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b., pid=103, masterSystemTime=1700916916507 2023-11-25 12:55:16,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:55:16,562 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-25 12:55:16,562 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-25 12:55:16,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-25 12:55:16,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:16,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:16,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:55:16,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 67ff462843156320a06b388981969e08, NAME => 'testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.', STARTKEY => '', ENDKEY => '1'} 2023-11-25 12:55:16,564 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=83bb1fd938e2dac427ea10eb612df94b, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:16,564 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916916564"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916916564"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916916564"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916916564"}]},"ts":"1700916916564"} 2023-11-25 12:55:16,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 67ff462843156320a06b388981969e08 2023-11-25 12:55:16,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:16,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 67ff462843156320a06b388981969e08 2023-11-25 12:55:16,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 67ff462843156320a06b388981969e08 2023-11-25 12:55:16,566 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-25 12:55:16,566 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-25 12:55:16,566 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HStore(1912): 83bb1fd938e2dac427ea10eb612df94b/family2 is initiating minor compaction (all files) 2023-11-25 12:55:16,566 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1912): 83bb1fd938e2dac427ea10eb612df94b/family1 is initiating minor compaction (all files) 2023-11-25 12:55:16,566 INFO [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 83bb1fd938e2dac427ea10eb612df94b/family2 in testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:16,566 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 83bb1fd938e2dac427ea10eb612df94b/family1 in testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:55:16,567 INFO [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-ae489c65d08a4d8cbc577a6328d55457, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-989ea3407e3e482ea311244936a911e7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-6f625c396cb64b959f114cbe8bbb4b1b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-7e6eb2a8fe5744be9aa79224db3313df] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp, totalSize=20.4 K 2023-11-25 12:55:16,567 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-1704ad43983c480b94486ba126258b57, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-9aea3ef5e85b48beb6d198de95dc2e9d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-f4f3643f6ee74d76bd28b3bd8e7e7cd7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-09f9e484c4b8441385cac64dca4800f3] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp, totalSize=21.6 K 2023-11-25 12:55:16,567 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-ae489c65d08a4d8cbc577a6328d55457, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916894211 2023-11-25 12:55:16,568 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-1704ad43983c480b94486ba126258b57, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916894211 2023-11-25 12:55:16,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=103, resume processing ppid=100 2023-11-25 12:55:16,568 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-989ea3407e3e482ea311244936a911e7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916896007 2023-11-25 12:55:16,568 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-9aea3ef5e85b48beb6d198de95dc2e9d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916896007 2023-11-25 12:55:16,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; OpenRegionProcedure 83bb1fd938e2dac427ea10eb612df94b, server=jenkins-hbase4.apache.org,37051,1700916801082 in 210 msec 2023-11-25 12:55:16,569 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=83bb1fd938e2dac427ea10eb612df94b, ASSIGN in 368 msec 2023-11-25 12:55:16,569 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-6f625c396cb64b959f114cbe8bbb4b1b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916897011 2023-11-25 12:55:16,569 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-f4f3643f6ee74d76bd28b3bd8e7e7cd7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916897011 2023-11-25 12:55:16,570 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-7e6eb2a8fe5744be9aa79224db3313df, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916898795 2023-11-25 12:55:16,570 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-09f9e484c4b8441385cac64dca4800f3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916898795 2023-11-25 12:55:16,573 INFO [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 67ff462843156320a06b388981969e08 2023-11-25 12:55:16,586 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1 2023-11-25 12:55:16,586 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1 2023-11-25 12:55:16,586 INFO [StoreOpener-67ff462843156320a06b388981969e08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67ff462843156320a06b388981969e08 columnFamilyName family1 2023-11-25 12:55:16,608 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-07726c1afd6241899cd789707c62d600 2023-11-25 12:55:16,624 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-471575781e8a4ed1bfd7cb92ac6782f1 2023-11-25 12:55:16,628 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 83bb1fd938e2dac427ea10eb612df94b#family1#compaction#112 average throughput is 0.47 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 53.85 MB/second 2023-11-25 12:55:16,638 INFO [RS:0;jenkins-hbase4:37051-longCompactions-0] throttle.PressureAwareThroughputController(145): 83bb1fd938e2dac427ea10eb612df94b#family2#compaction#113 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-25 12:55:16,639 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-59dcba9e5a014d46b8790903fb043f04 2023-11-25 12:55:16,655 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-b63312e19f6e4ef2ab5a7dac9ecdbcc6 2023-11-25 12:55:16,655 INFO [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(310): Store=67ff462843156320a06b388981969e08/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:16,655 INFO [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 67ff462843156320a06b388981969e08 2023-11-25 12:55:16,657 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2 2023-11-25 12:55:16,657 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2 2023-11-25 12:55:16,657 INFO [StoreOpener-67ff462843156320a06b388981969e08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67ff462843156320a06b388981969e08 columnFamilyName family2 2023-11-25 12:55:16,666 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-527a6b3539da400199c0149e8751990d 2023-11-25 12:55:16,671 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-c6bc3e563e3043f68c114803466cb070 2023-11-25 12:55:16,675 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-ed5e90748066410499e8750ef2575697 2023-11-25 12:55:16,679 DEBUG [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-ed7c3e9141634382a3bff703fe6853db 2023-11-25 12:55:16,679 INFO [StoreOpener-67ff462843156320a06b388981969e08-1] regionserver.HStore(310): Store=67ff462843156320a06b388981969e08/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:16,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08 2023-11-25 12:55:16,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08 2023-11-25 12:55:16,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-25 12:55:16,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 67ff462843156320a06b388981969e08 2023-11-25 12:55:16,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 67ff462843156320a06b388981969e08; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75322485, jitterRate=0.12239249050617218}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-25 12:55:16,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:55:16,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08., pid=102, masterSystemTime=1700916916507 2023-11-25 12:55:16,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-25 12:55:16,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-25 12:55:16,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:55:16,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:55:16,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:55:16,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b003b003481e082b6bae5bad39b1e617, NAME => 'testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.', STARTKEY => '1', ENDKEY => '2'} 2023-11-25 12:55:16,688 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=67ff462843156320a06b388981969e08, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:16,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b003b003481e082b6bae5bad39b1e617 2023-11-25 12:55:16,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:16,688 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700916916688"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916916688"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916916688"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916916688"}]},"ts":"1700916916688"} 2023-11-25 12:55:16,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b003b003481e082b6bae5bad39b1e617 2023-11-25 12:55:16,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b003b003481e082b6bae5bad39b1e617 2023-11-25 12:55:16,689 INFO [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b003b003481e082b6bae5bad39b1e617 2023-11-25 12:55:16,691 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1 2023-11-25 12:55:16,691 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1 2023-11-25 12:55:16,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=102, resume processing ppid=98 2023-11-25 12:55:16,691 INFO [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b003b003481e082b6bae5bad39b1e617 columnFamilyName family1 2023-11-25 12:55:16,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure 67ff462843156320a06b388981969e08, server=jenkins-hbase4.apache.org,37051,1700916801082 in 333 msec 2023-11-25 12:55:16,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=67ff462843156320a06b388981969e08, ASSIGN in 491 msec 2023-11-25 12:55:16,698 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-0484872de8294cbd8239c4b9cdaa8a93 2023-11-25 12:55:16,702 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-246af697b1ed43e8b70b20ffe6a1b2a4 2023-11-25 12:55:16,706 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-402caeedd9b94e568a24afc6a10746d3 2023-11-25 12:55:16,710 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-9a63db5e301740ed967c31caa1581f4c 2023-11-25 12:55:16,711 INFO [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(310): Store=b003b003481e082b6bae5bad39b1e617/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:16,711 INFO [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b003b003481e082b6bae5bad39b1e617 2023-11-25 12:55:16,712 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2 2023-11-25 12:55:16,712 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2 2023-11-25 12:55:16,712 INFO [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b003b003481e082b6bae5bad39b1e617 columnFamilyName family2 2023-11-25 12:55:16,719 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-40faa7648fc64badaaa8d4416eb12d13 2023-11-25 12:55:16,725 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-515ef8a66e28483d84c469f3c2d7599f 2023-11-25 12:55:16,729 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-6c9b4e0294134ed49933d99c40c86d5d 2023-11-25 12:55:16,735 DEBUG [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(539): loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-792afde68bc9441d9b19037d4f08eb1d 2023-11-25 12:55:16,735 INFO [StoreOpener-b003b003481e082b6bae5bad39b1e617-1] regionserver.HStore(310): Store=b003b003481e082b6bae5bad39b1e617/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:16,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617 2023-11-25 12:55:16,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617 2023-11-25 12:55:16,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-25 12:55:16,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b003b003481e082b6bae5bad39b1e617 2023-11-25 12:55:16,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b003b003481e082b6bae5bad39b1e617; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60006396, jitterRate=-0.10583502054214478}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-25 12:55:16,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:55:16,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617., pid=101, masterSystemTime=1700916916507 2023-11-25 12:55:16,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-25 12:55:16,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-25 12:55:16,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:55:16,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:55:16,743 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=b003b003481e082b6bae5bad39b1e617, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:16,743 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700916916743"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916916743"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916916743"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916916743"}]},"ts":"1700916916743"} 2023-11-25 12:55:16,746 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=101, resume processing ppid=99 2023-11-25 12:55:16,746 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure b003b003481e082b6bae5bad39b1e617, server=jenkins-hbase4.apache.org,37051,1700916801082 in 389 msec 2023-11-25 12:55:16,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=99, resume processing ppid=97 2023-11-25 12:55:16,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b003b003481e082b6bae5bad39b1e617, ASSIGN in 546 msec 2023-11-25 12:55:16,748 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916916748"}]},"ts":"1700916916748"} 2023-11-25 12:55:16,750 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-25 12:55:16,752 INFO [PEWorker-4] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-25 12:55:16,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 566 msec 2023-11-25 12:55:16,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-25 12:55:16,801 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-25 12:55:16,817 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:16,827 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:16,839 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:16,840 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:16,846 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-25 12:55:16,861 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-25 12:55:16,862 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:16,863 DEBUG [Listener at localhost/45289] zookeeper.ReadOnlyZKClient(139): Connect 0x0f474d3e to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:55:16,868 DEBUG [Listener at localhost/45289] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b0222d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:55:16,868 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231125 for table='testCompactionWithHFileLink' and column='family1' 2023-11-25 12:55:16,868 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231125 for table='testCompactionWithHFileLink' and column='family1' 2023-11-25 12:55:16,868 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231125 for table='testCompactionWithHFileLink' and column='family1' 2023-11-25 12:55:17,074 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family2/688923925315413ba88d89aa67445ede as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/688923925315413ba88d89aa67445ede 2023-11-25 12:55:17,079 INFO [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 83bb1fd938e2dac427ea10eb612df94b/family2 of 83bb1fd938e2dac427ea10eb612df94b into 688923925315413ba88d89aa67445ede(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:55:17,079 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:55:17,079 INFO [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b., storeName=83bb1fd938e2dac427ea10eb612df94b/family2, priority=12, startTime=1700916916562; duration=0sec 2023-11-25 12:55:17,079 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-25 12:55:17,080 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-25 12:55:17,081 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-25 12:55:17,082 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HStore(1912): 67ff462843156320a06b388981969e08/family1 is initiating minor compaction (all files) 2023-11-25 12:55:17,082 INFO [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 67ff462843156320a06b388981969e08/family1 in testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:55:17,082 INFO [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-07726c1afd6241899cd789707c62d600, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-471575781e8a4ed1bfd7cb92ac6782f1, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-b63312e19f6e4ef2ab5a7dac9ecdbcc6, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-59dcba9e5a014d46b8790903fb043f04] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp, totalSize=21.6 K 2023-11-25 12:55:17,082 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=67ff462843156320a06b388981969e08-07726c1afd6241899cd789707c62d600, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916894208 2023-11-25 12:55:17,083 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=67ff462843156320a06b388981969e08-471575781e8a4ed1bfd7cb92ac6782f1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916896006 2023-11-25 12:55:17,083 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=67ff462843156320a06b388981969e08-b63312e19f6e4ef2ab5a7dac9ecdbcc6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916897011 2023-11-25 12:55:17,084 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=67ff462843156320a06b388981969e08-59dcba9e5a014d46b8790903fb043f04, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916898795 2023-11-25 12:55:17,095 INFO [RS:0;jenkins-hbase4:37051-longCompactions-0] throttle.PressureAwareThroughputController(145): 67ff462843156320a06b388981969e08#family1#compaction#114 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-25 12:55:17,113 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-ae489c65d08a4d8cbc577a6328d55457, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-989ea3407e3e482ea311244936a911e7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-6f625c396cb64b959f114cbe8bbb4b1b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-7e6eb2a8fe5744be9aa79224db3313df] to archive 2023-11-25 12:55:17,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:17,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-ae489c65d08a4d8cbc577a6328d55457 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-ae489c65d08a4d8cbc577a6328d55457 2023-11-25 12:55:17,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-989ea3407e3e482ea311244936a911e7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-989ea3407e3e482ea311244936a911e7 2023-11-25 12:55:17,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-6f625c396cb64b959f114cbe8bbb4b1b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-6f625c396cb64b959f114cbe8bbb4b1b 2023-11-25 12:55:17,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-7e6eb2a8fe5744be9aa79224db3313df to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family2/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-7e6eb2a8fe5744be9aa79224db3313df 2023-11-25 12:55:17,471 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/.tmp/family1/6c885cb4b9b8459aac491dc9279a7622 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/6c885cb4b9b8459aac491dc9279a7622 2023-11-25 12:55:17,476 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 83bb1fd938e2dac427ea10eb612df94b/family1 of 83bb1fd938e2dac427ea10eb612df94b into 6c885cb4b9b8459aac491dc9279a7622(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:55:17,476 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:55:17,476 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b., storeName=83bb1fd938e2dac427ea10eb612df94b/family1, priority=12, startTime=1700916916562; duration=0sec 2023-11-25 12:55:17,476 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-25 12:55:17,477 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-25 12:55:17,479 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-25 12:55:17,479 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1912): b003b003481e082b6bae5bad39b1e617/family2 is initiating minor compaction (all files) 2023-11-25 12:55:17,479 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b003b003481e082b6bae5bad39b1e617/family2 in testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:55:17,479 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-515ef8a66e28483d84c469f3c2d7599f, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-40faa7648fc64badaaa8d4416eb12d13, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-6c9b4e0294134ed49933d99c40c86d5d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-792afde68bc9441d9b19037d4f08eb1d] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp, totalSize=20.4 K 2023-11-25 12:55:17,479 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-515ef8a66e28483d84c469f3c2d7599f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916894210 2023-11-25 12:55:17,480 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-40faa7648fc64badaaa8d4416eb12d13, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916896007 2023-11-25 12:55:17,480 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-6c9b4e0294134ed49933d99c40c86d5d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916897011 2023-11-25 12:55:17,481 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-792afde68bc9441d9b19037d4f08eb1d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916898795 2023-11-25 12:55:17,493 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): b003b003481e082b6bae5bad39b1e617#family2#compaction#115 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-25 12:55:17,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-1704ad43983c480b94486ba126258b57, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-9aea3ef5e85b48beb6d198de95dc2e9d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-f4f3643f6ee74d76bd28b3bd8e7e7cd7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-09f9e484c4b8441385cac64dca4800f3] to archive 2023-11-25 12:55:17,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:17,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-1704ad43983c480b94486ba126258b57 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-1704ad43983c480b94486ba126258b57 2023-11-25 12:55:17,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-9aea3ef5e85b48beb6d198de95dc2e9d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-9aea3ef5e85b48beb6d198de95dc2e9d 2023-11-25 12:55:17,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-f4f3643f6ee74d76bd28b3bd8e7e7cd7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-f4f3643f6ee74d76bd28b3bd8e7e7cd7 2023-11-25 12:55:17,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-09f9e484c4b8441385cac64dca4800f3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/testCompactionWithHFileLink=83bb1fd938e2dac427ea10eb612df94b-09f9e484c4b8441385cac64dca4800f3 2023-11-25 12:55:17,764 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112560c8d29ebb674e7ebf6ec34f5fcff5d3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112560c8d29ebb674e7ebf6ec34f5fcff5d3 2023-11-25 12:55:17,764 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125328a6e9c68974353b32dad282f47df6c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231125328a6e9c68974353b32dad282f47df6c 2023-11-25 12:55:17,764 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231125 table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:17,765 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231125 table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:17,765 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112584892a8bcd7e464b95bca84f32b1da58 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112584892a8bcd7e464b95bca84f32b1da58 2023-11-25 12:55:17,766 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231125 table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:17,780 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:55:17,784 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:55:17,792 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:55:17,795 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:55:17,818 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231125/family1/645df56866744a6a86e2b524678d5410 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-25 12:55:17,818 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231125/family1/2a7eb079edd041799fc7809137be39a8 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-25 12:55:17,819 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231125/family1/645df56866744a6a86e2b524678d5410}] 2023-11-25 12:55:17,819 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=32 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231125/family1/2a7eb079edd041799fc7809137be39a8}] 2023-11-25 12:55:17,821 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231125/family1/e7ece00c62e34fd48898c8a825dfe247 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-25 12:55:17,823 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231125/family1/e7ece00c62e34fd48898c8a825dfe247}] 2023-11-25 12:55:17,833 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231125/family1/645df56866744a6a86e2b524678d5410 for inclusion in 83bb1fd938e2dac427ea10eb612df94b/family1 2023-11-25 12:55:17,833 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231125/family1/2a7eb079edd041799fc7809137be39a8 for inclusion in 67ff462843156320a06b388981969e08/family1 2023-11-25 12:55:17,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231125/family1/e7ece00c62e34fd48898c8a825dfe247 for inclusion in b003b003481e082b6bae5bad39b1e617/family1 2023-11-25 12:55:17,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-25 12:55:17,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-25 12:55:17,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last=1 2023-11-25 12:55:17,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-25 12:55:17,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:55:17,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-25 12:55:17,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-25 12:55:17,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:55:17,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:55:17,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231125/family1/2a7eb079edd041799fc7809137be39a8 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__k2bi4ip9k12q8nkjnc1bnoupq4b8eh9u2pvd6orl9e5stbo72dfqap69jd33k3v3/family1/2a7eb079edd041799fc7809137be39a8 2023-11-25 12:55:17,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231125/family1/e7ece00c62e34fd48898c8a825dfe247 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__f28h19598r07tandhhod51ebd6vvl9m6l58856ns3alifbc9k9ocs2jlsbko48t4/family1/e7ece00c62e34fd48898c8a825dfe247 2023-11-25 12:55:17,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231125/family1/645df56866744a6a86e2b524678d5410 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__48annt9p9724avblb5h1lvgfsclfg7s6op7b5o8net99aihuc11o4meoq1e0e1ds/family1/645df56866744a6a86e2b524678d5410 2023-11-25 12:55:17,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__k2bi4ip9k12q8nkjnc1bnoupq4b8eh9u2pvd6orl9e5stbo72dfqap69jd33k3v3/family1/2a7eb079edd041799fc7809137be39a8 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/31a97a09b3284ee3a8549d4627f54361_SeqId_34_ 2023-11-25 12:55:17,844 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__k2bi4ip9k12q8nkjnc1bnoupq4b8eh9u2pvd6orl9e5stbo72dfqap69jd33k3v3/family1/2a7eb079edd041799fc7809137be39a8 into 67ff462843156320a06b388981969e08/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/31a97a09b3284ee3a8549d4627f54361_SeqId_34_ - updating store file list. 2023-11-25 12:55:17,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__48annt9p9724avblb5h1lvgfsclfg7s6op7b5o8net99aihuc11o4meoq1e0e1ds/family1/645df56866744a6a86e2b524678d5410 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/1c9a96c772a1432cb152c579d20d3478_SeqId_36_ 2023-11-25 12:55:17,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__f28h19598r07tandhhod51ebd6vvl9m6l58856ns3alifbc9k9ocs2jlsbko48t4/family1/e7ece00c62e34fd48898c8a825dfe247 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/2bcf9de2ddd54a61b4ed312525e7e6b6_SeqId_34_ 2023-11-25 12:55:17,845 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__48annt9p9724avblb5h1lvgfsclfg7s6op7b5o8net99aihuc11o4meoq1e0e1ds/family1/645df56866744a6a86e2b524678d5410 into 83bb1fd938e2dac427ea10eb612df94b/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/1c9a96c772a1432cb152c579d20d3478_SeqId_36_ - updating store file list. 2023-11-25 12:55:17,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__f28h19598r07tandhhod51ebd6vvl9m6l58856ns3alifbc9k9ocs2jlsbko48t4/family1/e7ece00c62e34fd48898c8a825dfe247 into b003b003481e082b6bae5bad39b1e617/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/2bcf9de2ddd54a61b4ed312525e7e6b6_SeqId_34_ - updating store file list. 2023-11-25 12:55:17,849 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/31a97a09b3284ee3a8549d4627f54361_SeqId_34_ into 67ff462843156320a06b388981969e08/family1 2023-11-25 12:55:17,849 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__k2bi4ip9k12q8nkjnc1bnoupq4b8eh9u2pvd6orl9e5stbo72dfqap69jd33k3v3/family1/2a7eb079edd041799fc7809137be39a8 into 67ff462843156320a06b388981969e08/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/31a97a09b3284ee3a8549d4627f54361_SeqId_34_) 2023-11-25 12:55:17,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__k2bi4ip9k12q8nkjnc1bnoupq4b8eh9u2pvd6orl9e5stbo72dfqap69jd33k3v3/family1/2a7eb079edd041799fc7809137be39a8 2023-11-25 12:55:17,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/2bcf9de2ddd54a61b4ed312525e7e6b6_SeqId_34_ into b003b003481e082b6bae5bad39b1e617/family1 2023-11-25 12:55:17,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__f28h19598r07tandhhod51ebd6vvl9m6l58856ns3alifbc9k9ocs2jlsbko48t4/family1/e7ece00c62e34fd48898c8a825dfe247 into b003b003481e082b6bae5bad39b1e617/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/2bcf9de2ddd54a61b4ed312525e7e6b6_SeqId_34_) 2023-11-25 12:55:17,851 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/1c9a96c772a1432cb152c579d20d3478_SeqId_36_ into 83bb1fd938e2dac427ea10eb612df94b/family1 2023-11-25 12:55:17,851 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__48annt9p9724avblb5h1lvgfsclfg7s6op7b5o8net99aihuc11o4meoq1e0e1ds/family1/645df56866744a6a86e2b524678d5410 into 83bb1fd938e2dac427ea10eb612df94b/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/family1/1c9a96c772a1432cb152c579d20d3478_SeqId_36_) 2023-11-25 12:55:17,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__f28h19598r07tandhhod51ebd6vvl9m6l58856ns3alifbc9k9ocs2jlsbko48t4/family1/e7ece00c62e34fd48898c8a825dfe247 2023-11-25 12:55:17,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:55:17,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testCompactionWithHFileLink__48annt9p9724avblb5h1lvgfsclfg7s6op7b5o8net99aihuc11o4meoq1e0e1ds/family1/645df56866744a6a86e2b524678d5410 2023-11-25 12:55:17,852 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231125 table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:17,853 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:17,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-25 12:55:17,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(1912): b003b003481e082b6bae5bad39b1e617/family1 is initiating minor compaction (all files) 2023-11-25 12:55:17,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@40ff41f3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-25 12:55:17,855 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231125220526c40aec47bb854d07d1d573ac46 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231125220526c40aec47bb854d07d1d573ac46 2023-11-25 12:55:17,856 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231125 table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:17,857 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:17,857 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231125676cf40d7da34837a7c5dcf63b1f513b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231125676cf40d7da34837a7c5dcf63b1f513b 2023-11-25 12:55:17,857 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231125 table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:17,858 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:17,859 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231125bca32b8c07b84895815709d9bd67ad79 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231125bca32b8c07b84895815709d9bd67ad79 2023-11-25 12:55:17,859 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023112546c57f4a81374d0bb97e16a0a03959ab to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023112546c57f4a81374d0bb97e16a0a03959ab 2023-11-25 12:55:17,860 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311255d76cd16f19f43b195ed2271761207d6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311255d76cd16f19f43b195ed2271761207d6 2023-11-25 12:55:17,861 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231125f09311caa24a441bb4f40be97b74aafc to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231125f09311caa24a441bb4f40be97b74aafc 2023-11-25 12:55:17,861 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-25 12:55:17,861 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231125' 2023-11-25 12:55:17,861 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311256f40d810d1e6487c95c8e8de18674aa5 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311256f40d810d1e6487c95c8e8de18674aa5 2023-11-25 12:55:17,861 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231125 for table='testCompactionWithHFileLink' and column='family1' 2023-11-25 12:55:17,862 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023112578fbe71b92a84181b85ecbd9a0ee1d26 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023112578fbe71b92a84181b85ecbd9a0ee1d26 2023-11-25 12:55:17,862 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023112571aad81045734d62be9ab3c0adf6307b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023112571aad81045734d62be9ab3c0adf6307b 2023-11-25 12:55:17,863 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231125c3cc86452438448b8af572e0a0b78451 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231125c3cc86452438448b8af572e0a0b78451 2023-11-25 12:55:17,863 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231125948117bd53f14bc59d112fd67ccc25d8 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231125948117bd53f14bc59d112fd67ccc25d8 2023-11-25 12:55:17,864 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-25 12:55:17,864 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231125' 2023-11-25 12:55:17,864 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231125ffba1b2181e744a1b948524ab5974b48 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231125ffba1b2181e744a1b948524ab5974b48 2023-11-25 12:55:17,864 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-25 12:55:17,864 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231125' 2023-11-25 12:55:17,864 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231125 for table='testCompactionWithHFileLink' and column='family1' 2023-11-25 12:55:17,864 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231125 for table='testCompactionWithHFileLink' and column='family1' 2023-11-25 12:55:17,865 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-25 12:55:17,868 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:17,870 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:17,877 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:17,878 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:17,885 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:17,886 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:17,901 INFO [Listener at localhost/45289] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=288 (was 239) - Thread LEAK? -, OpenFileDescriptor=783 (was 629) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=162 (was 170), ProcessCount=167 (was 170), AvailableMemoryMB=7993 (was 8013) 2023-11-25 12:55:17,915 INFO [Listener at localhost/45289] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=287, OpenFileDescriptor=783, MaxFileDescriptor=60000, SystemLoadAverage=162, ProcessCount=167, AvailableMemoryMB=7992 2023-11-25 12:55:17,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-11-25 12:55:17,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-25 12:55:17,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-25 12:55:17,927 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-25 12:55:17,929 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 8 msec 2023-11-25 12:55:18,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-25 12:55:18,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-25 12:55:18,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-25 12:55:18,030 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-25 12:55:18,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-25 12:55:18,030 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-25 12:55:18,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-25 12:55:18,032 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8 2023-11-25 12:55:18,032 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d 2023-11-25 12:55:18,032 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d 2023-11-25 12:55:18,033 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8 empty. 2023-11-25 12:55:18,033 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d empty. 2023-11-25 12:55:18,033 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d empty. 2023-11-25 12:55:18,033 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8 2023-11-25 12:55:18,033 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d 2023-11-25 12:55:18,033 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d 2023-11-25 12:55:18,033 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-25 12:55:18,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-25 12:55:18,315 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family1/b4be32b6393b435ab330c7de6584169c as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/b4be32b6393b435ab330c7de6584169c 2023-11-25 12:55:18,318 INFO [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 67ff462843156320a06b388981969e08/family1 of 67ff462843156320a06b388981969e08 into b4be32b6393b435ab330c7de6584169c(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:55:18,318 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:55:18,318 INFO [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08., storeName=67ff462843156320a06b388981969e08/family1, priority=12, startTime=1700916916686; duration=1sec 2023-11-25 12:55:18,319 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-25 12:55:18,319 INFO [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HRegion(2259): Starting compaction of b003b003481e082b6bae5bad39b1e617/family1 in testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:55:18,319 INFO [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-9a63db5e301740ed967c31caa1581f4c, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-0484872de8294cbd8239c4b9cdaa8a93, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-246af697b1ed43e8b70b20ffe6a1b2a4, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-402caeedd9b94e568a24afc6a10746d3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/2bcf9de2ddd54a61b4ed312525e7e6b6_SeqId_34_] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp, totalSize=28.9 K 2023-11-25 12:55:18,319 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-9a63db5e301740ed967c31caa1581f4c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916894210 2023-11-25 12:55:18,320 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-0484872de8294cbd8239c4b9cdaa8a93, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916896007 2023-11-25 12:55:18,320 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-246af697b1ed43e8b70b20ffe6a1b2a4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916897011 2023-11-25 12:55:18,321 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-402caeedd9b94e568a24afc6a10746d3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916898795 2023-11-25 12:55:18,321 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] compactions.Compactor(207): Compacting 2bcf9de2ddd54a61b4ed312525e7e6b6_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1700916894210 2023-11-25 12:55:18,332 INFO [RS:0;jenkins-hbase4:37051-longCompactions-0] throttle.PressureAwareThroughputController(145): b003b003481e082b6bae5bad39b1e617#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-25 12:55:18,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-25 12:55:18,414 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-07726c1afd6241899cd789707c62d600, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-471575781e8a4ed1bfd7cb92ac6782f1, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-b63312e19f6e4ef2ab5a7dac9ecdbcc6, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-59dcba9e5a014d46b8790903fb043f04] to archive 2023-11-25 12:55:18,415 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:18,417 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-07726c1afd6241899cd789707c62d600 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-07726c1afd6241899cd789707c62d600 2023-11-25 12:55:18,418 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-471575781e8a4ed1bfd7cb92ac6782f1 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-471575781e8a4ed1bfd7cb92ac6782f1 2023-11-25 12:55:18,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-b63312e19f6e4ef2ab5a7dac9ecdbcc6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-b63312e19f6e4ef2ab5a7dac9ecdbcc6 2023-11-25 12:55:18,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-59dcba9e5a014d46b8790903fb043f04 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family1/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-59dcba9e5a014d46b8790903fb043f04 2023-11-25 12:55:18,440 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-25 12:55:18,441 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => c902f29bb39df121448280b255efeb4d, NAME => 'ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:55:18,442 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 429309f3707a667a7044d0fa7d8d576d, NAME => 'ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:55:18,442 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 28de3526844060bb212fbaedf7d89ec8, NAME => 'ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:55:18,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-25 12:55:18,718 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family2/2ac61a142cfb4aa4b13963e528f9009d as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/2ac61a142cfb4aa4b13963e528f9009d 2023-11-25 12:55:18,723 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in b003b003481e082b6bae5bad39b1e617/family2 of b003b003481e082b6bae5bad39b1e617 into 2ac61a142cfb4aa4b13963e528f9009d(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:55:18,723 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:55:18,723 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617., storeName=b003b003481e082b6bae5bad39b1e617/family2, priority=12, startTime=1700916916741; duration=1sec 2023-11-25 12:55:18,723 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-25 12:55:18,723 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-11-25 12:55:18,723 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-25 12:55:18,723 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-25 12:55:18,723 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. because compaction request was cancelled 2023-11-25 12:55:18,723 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-25 12:55:18,725 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-25 12:55:18,726 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1912): 67ff462843156320a06b388981969e08/family2 is initiating minor compaction (all files) 2023-11-25 12:55:18,726 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 67ff462843156320a06b388981969e08/family2 in testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:55:18,726 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-ed5e90748066410499e8750ef2575697, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-527a6b3539da400199c0149e8751990d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-ed7c3e9141634382a3bff703fe6853db, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-c6bc3e563e3043f68c114803466cb070] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp, totalSize=20.4 K 2023-11-25 12:55:18,726 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=67ff462843156320a06b388981969e08-ed5e90748066410499e8750ef2575697, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916894208 2023-11-25 12:55:18,727 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=67ff462843156320a06b388981969e08-527a6b3539da400199c0149e8751990d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916896006 2023-11-25 12:55:18,727 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=67ff462843156320a06b388981969e08-ed7c3e9141634382a3bff703fe6853db, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916897011 2023-11-25 12:55:18,728 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=67ff462843156320a06b388981969e08-c6bc3e563e3043f68c114803466cb070, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916898795 2023-11-25 12:55:18,740 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 67ff462843156320a06b388981969e08#family2#compaction#117 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-25 12:55:18,787 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-25 12:55:18,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-515ef8a66e28483d84c469f3c2d7599f, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-40faa7648fc64badaaa8d4416eb12d13, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-6c9b4e0294134ed49933d99c40c86d5d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-792afde68bc9441d9b19037d4f08eb1d] to archive 2023-11-25 12:55:18,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:18,825 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-515ef8a66e28483d84c469f3c2d7599f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-515ef8a66e28483d84c469f3c2d7599f 2023-11-25 12:55:18,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-40faa7648fc64badaaa8d4416eb12d13 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-40faa7648fc64badaaa8d4416eb12d13 2023-11-25 12:55:18,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-6c9b4e0294134ed49933d99c40c86d5d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-6c9b4e0294134ed49933d99c40c86d5d 2023-11-25 12:55:18,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-792afde68bc9441d9b19037d4f08eb1d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family2/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-792afde68bc9441d9b19037d4f08eb1d 2023-11-25 12:55:18,847 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:18,847 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 429309f3707a667a7044d0fa7d8d576d, disabling compactions & flushes 2023-11-25 12:55:18,847 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:18,847 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:18,847 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. after waiting 0 ms 2023-11-25 12:55:18,847 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:18,847 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:18,847 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 429309f3707a667a7044d0fa7d8d576d: 2023-11-25 12:55:18,848 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:18,848 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing c902f29bb39df121448280b255efeb4d, disabling compactions & flushes 2023-11-25 12:55:18,848 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:18,848 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:18,848 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. after waiting 0 ms 2023-11-25 12:55:18,848 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:18,848 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:18,848 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for c902f29bb39df121448280b255efeb4d: 2023-11-25 12:55:18,848 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:18,848 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 28de3526844060bb212fbaedf7d89ec8, disabling compactions & flushes 2023-11-25 12:55:18,848 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:18,848 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:18,848 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. after waiting 0 ms 2023-11-25 12:55:18,848 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:18,848 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:18,848 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 28de3526844060bb212fbaedf7d89ec8: 2023-11-25 12:55:18,850 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-25 12:55:18,851 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700916918851"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916918851"}]},"ts":"1700916918851"} 2023-11-25 12:55:18,852 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700916918851"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916918851"}]},"ts":"1700916918851"} 2023-11-25 12:55:18,852 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700916918851"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916918851"}]},"ts":"1700916918851"} 2023-11-25 12:55:18,853 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-25 12:55:18,854 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-25 12:55:18,854 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916918854"}]},"ts":"1700916918854"} 2023-11-25 12:55:18,855 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-25 12:55:18,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=28de3526844060bb212fbaedf7d89ec8, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=429309f3707a667a7044d0fa7d8d576d, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c902f29bb39df121448280b255efeb4d, ASSIGN}] 2023-11-25 12:55:18,864 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=429309f3707a667a7044d0fa7d8d576d, ASSIGN 2023-11-25 12:55:18,864 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c902f29bb39df121448280b255efeb4d, ASSIGN 2023-11-25 12:55:18,864 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=28de3526844060bb212fbaedf7d89ec8, ASSIGN 2023-11-25 12:55:18,865 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c902f29bb39df121448280b255efeb4d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:55:18,865 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=28de3526844060bb212fbaedf7d89ec8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:55:18,865 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=429309f3707a667a7044d0fa7d8d576d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:55:19,018 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=429309f3707a667a7044d0fa7d8d576d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:19,018 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=c902f29bb39df121448280b255efeb4d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:19,018 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=28de3526844060bb212fbaedf7d89ec8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:19,019 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700916919018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916919018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916919018"}]},"ts":"1700916919018"} 2023-11-25 12:55:19,019 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700916919018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916919018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916919018"}]},"ts":"1700916919018"} 2023-11-25 12:55:19,019 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700916919018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916919018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916919018"}]},"ts":"1700916919018"} 2023-11-25 12:55:19,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 429309f3707a667a7044d0fa7d8d576d, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:55:19,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure c902f29bb39df121448280b255efeb4d, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:55:19,022 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=106, state=RUNNABLE; OpenRegionProcedure 28de3526844060bb212fbaedf7d89ec8, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:55:19,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-25 12:55:19,150 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/.tmp/family1/5427ad9e904840d8b01184ed7f0b8427 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/5427ad9e904840d8b01184ed7f0b8427 2023-11-25 12:55:19,155 INFO [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in b003b003481e082b6bae5bad39b1e617/family1 of b003b003481e082b6bae5bad39b1e617 into 5427ad9e904840d8b01184ed7f0b8427(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:55:19,155 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:55:19,156 INFO [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1700916917855; duration=0sec 2023-11-25 12:55:19,156 DEBUG [RS:0;jenkins-hbase4:37051-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:55:19,172 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:19,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:19,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 28de3526844060bb212fbaedf7d89ec8, NAME => 'ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8.', STARTKEY => '', ENDKEY => '1'} 2023-11-25 12:55:19,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 28de3526844060bb212fbaedf7d89ec8 2023-11-25 12:55:19,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:19,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 28de3526844060bb212fbaedf7d89ec8 2023-11-25 12:55:19,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 28de3526844060bb212fbaedf7d89ec8 2023-11-25 12:55:19,177 INFO [StoreOpener-28de3526844060bb212fbaedf7d89ec8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 28de3526844060bb212fbaedf7d89ec8 2023-11-25 12:55:19,178 DEBUG [StoreOpener-28de3526844060bb212fbaedf7d89ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1 2023-11-25 12:55:19,179 DEBUG [StoreOpener-28de3526844060bb212fbaedf7d89ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1 2023-11-25 12:55:19,179 INFO [StoreOpener-28de3526844060bb212fbaedf7d89ec8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28de3526844060bb212fbaedf7d89ec8 columnFamilyName family1 2023-11-25 12:55:19,181 INFO [StoreOpener-28de3526844060bb212fbaedf7d89ec8-1] regionserver.HStore(310): Store=28de3526844060bb212fbaedf7d89ec8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:19,181 INFO [StoreOpener-28de3526844060bb212fbaedf7d89ec8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 28de3526844060bb212fbaedf7d89ec8 2023-11-25 12:55:19,182 DEBUG [StoreOpener-28de3526844060bb212fbaedf7d89ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2 2023-11-25 12:55:19,182 DEBUG [StoreOpener-28de3526844060bb212fbaedf7d89ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2 2023-11-25 12:55:19,183 INFO [StoreOpener-28de3526844060bb212fbaedf7d89ec8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28de3526844060bb212fbaedf7d89ec8 columnFamilyName family2 2023-11-25 12:55:19,184 INFO [StoreOpener-28de3526844060bb212fbaedf7d89ec8-1] regionserver.HStore(310): Store=28de3526844060bb212fbaedf7d89ec8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:19,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8 2023-11-25 12:55:19,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8 2023-11-25 12:55:19,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-25 12:55:19,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 28de3526844060bb212fbaedf7d89ec8 2023-11-25 12:55:19,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:55:19,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 28de3526844060bb212fbaedf7d89ec8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71084971, jitterRate=0.05924861133098602}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-25 12:55:19,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 28de3526844060bb212fbaedf7d89ec8: 2023-11-25 12:55:19,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8., pid=111, masterSystemTime=1700916919172 2023-11-25 12:55:19,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:19,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:19,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:19,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c902f29bb39df121448280b255efeb4d, NAME => 'ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d.', STARTKEY => '2', ENDKEY => ''} 2023-11-25 12:55:19,191 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=28de3526844060bb212fbaedf7d89ec8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:19,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction c902f29bb39df121448280b255efeb4d 2023-11-25 12:55:19,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:19,191 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700916919191"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916919191"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916919191"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916919191"}]},"ts":"1700916919191"} 2023-11-25 12:55:19,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c902f29bb39df121448280b255efeb4d 2023-11-25 12:55:19,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c902f29bb39df121448280b255efeb4d 2023-11-25 12:55:19,193 INFO [StoreOpener-c902f29bb39df121448280b255efeb4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c902f29bb39df121448280b255efeb4d 2023-11-25 12:55:19,194 DEBUG [StoreOpener-c902f29bb39df121448280b255efeb4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1 2023-11-25 12:55:19,194 DEBUG [StoreOpener-c902f29bb39df121448280b255efeb4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1 2023-11-25 12:55:19,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=111, resume processing ppid=106 2023-11-25 12:55:19,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=106, state=SUCCESS; OpenRegionProcedure 28de3526844060bb212fbaedf7d89ec8, server=jenkins-hbase4.apache.org,37051,1700916801082 in 171 msec 2023-11-25 12:55:19,194 INFO [StoreOpener-c902f29bb39df121448280b255efeb4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c902f29bb39df121448280b255efeb4d columnFamilyName family1 2023-11-25 12:55:19,195 INFO [StoreOpener-c902f29bb39df121448280b255efeb4d-1] regionserver.HStore(310): Store=c902f29bb39df121448280b255efeb4d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:19,195 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=28de3526844060bb212fbaedf7d89ec8, ASSIGN in 332 msec 2023-11-25 12:55:19,195 INFO [StoreOpener-c902f29bb39df121448280b255efeb4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c902f29bb39df121448280b255efeb4d 2023-11-25 12:55:19,196 DEBUG [StoreOpener-c902f29bb39df121448280b255efeb4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2 2023-11-25 12:55:19,196 DEBUG [StoreOpener-c902f29bb39df121448280b255efeb4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2 2023-11-25 12:55:19,196 INFO [StoreOpener-c902f29bb39df121448280b255efeb4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c902f29bb39df121448280b255efeb4d columnFamilyName family2 2023-11-25 12:55:19,197 INFO [StoreOpener-c902f29bb39df121448280b255efeb4d-1] regionserver.HStore(310): Store=c902f29bb39df121448280b255efeb4d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:19,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d 2023-11-25 12:55:19,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d 2023-11-25 12:55:19,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-25 12:55:19,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c902f29bb39df121448280b255efeb4d 2023-11-25 12:55:19,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:55:19,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c902f29bb39df121448280b255efeb4d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65827954, jitterRate=-0.0190870463848114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-25 12:55:19,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c902f29bb39df121448280b255efeb4d: 2023-11-25 12:55:19,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d., pid=110, masterSystemTime=1700916919172 2023-11-25 12:55:19,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:19,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:19,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:19,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 429309f3707a667a7044d0fa7d8d576d, NAME => 'ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d.', STARTKEY => '1', ENDKEY => '2'} 2023-11-25 12:55:19,203 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=c902f29bb39df121448280b255efeb4d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:19,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 429309f3707a667a7044d0fa7d8d576d 2023-11-25 12:55:19,203 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700916919203"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916919203"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916919203"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916919203"}]},"ts":"1700916919203"} 2023-11-25 12:55:19,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:19,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 429309f3707a667a7044d0fa7d8d576d 2023-11-25 12:55:19,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 429309f3707a667a7044d0fa7d8d576d 2023-11-25 12:55:19,204 INFO [StoreOpener-429309f3707a667a7044d0fa7d8d576d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 429309f3707a667a7044d0fa7d8d576d 2023-11-25 12:55:19,205 DEBUG [StoreOpener-429309f3707a667a7044d0fa7d8d576d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1 2023-11-25 12:55:19,205 DEBUG [StoreOpener-429309f3707a667a7044d0fa7d8d576d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1 2023-11-25 12:55:19,205 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=110, resume processing ppid=108 2023-11-25 12:55:19,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure c902f29bb39df121448280b255efeb4d, server=jenkins-hbase4.apache.org,37051,1700916801082 in 183 msec 2023-11-25 12:55:19,206 INFO [StoreOpener-429309f3707a667a7044d0fa7d8d576d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 429309f3707a667a7044d0fa7d8d576d columnFamilyName family1 2023-11-25 12:55:19,206 INFO [StoreOpener-429309f3707a667a7044d0fa7d8d576d-1] regionserver.HStore(310): Store=429309f3707a667a7044d0fa7d8d576d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:19,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c902f29bb39df121448280b255efeb4d, ASSIGN in 344 msec 2023-11-25 12:55:19,207 INFO [StoreOpener-429309f3707a667a7044d0fa7d8d576d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 429309f3707a667a7044d0fa7d8d576d 2023-11-25 12:55:19,207 DEBUG [StoreOpener-429309f3707a667a7044d0fa7d8d576d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2 2023-11-25 12:55:19,208 DEBUG [StoreOpener-429309f3707a667a7044d0fa7d8d576d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2 2023-11-25 12:55:19,208 INFO [StoreOpener-429309f3707a667a7044d0fa7d8d576d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 429309f3707a667a7044d0fa7d8d576d columnFamilyName family2 2023-11-25 12:55:19,208 INFO [StoreOpener-429309f3707a667a7044d0fa7d8d576d-1] regionserver.HStore(310): Store=429309f3707a667a7044d0fa7d8d576d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:19,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d 2023-11-25 12:55:19,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d 2023-11-25 12:55:19,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-25 12:55:19,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 429309f3707a667a7044d0fa7d8d576d 2023-11-25 12:55:19,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:55:19,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 429309f3707a667a7044d0fa7d8d576d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66036032, jitterRate=-0.01598644256591797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-25 12:55:19,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 429309f3707a667a7044d0fa7d8d576d: 2023-11-25 12:55:19,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d., pid=109, masterSystemTime=1700916919172 2023-11-25 12:55:19,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-9a63db5e301740ed967c31caa1581f4c, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-0484872de8294cbd8239c4b9cdaa8a93, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-246af697b1ed43e8b70b20ffe6a1b2a4, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-402caeedd9b94e568a24afc6a10746d3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/2bcf9de2ddd54a61b4ed312525e7e6b6_SeqId_34_] to archive 2023-11-25 12:55:19,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:19,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:19,215 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:19,215 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=429309f3707a667a7044d0fa7d8d576d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:19,215 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700916919215"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916919215"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916919215"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916919215"}]},"ts":"1700916919215"} 2023-11-25 12:55:19,216 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-9a63db5e301740ed967c31caa1581f4c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-9a63db5e301740ed967c31caa1581f4c 2023-11-25 12:55:19,217 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=109, resume processing ppid=107 2023-11-25 12:55:19,217 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 429309f3707a667a7044d0fa7d8d576d, server=jenkins-hbase4.apache.org,37051,1700916801082 in 195 msec 2023-11-25 12:55:19,217 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-0484872de8294cbd8239c4b9cdaa8a93 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-0484872de8294cbd8239c4b9cdaa8a93 2023-11-25 12:55:19,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-246af697b1ed43e8b70b20ffe6a1b2a4 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-246af697b1ed43e8b70b20ffe6a1b2a4 2023-11-25 12:55:19,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=107, resume processing ppid=105 2023-11-25 12:55:19,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=429309f3707a667a7044d0fa7d8d576d, ASSIGN in 355 msec 2023-11-25 12:55:19,219 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-25 12:55:19,219 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916919219"}]},"ts":"1700916919219"} 2023-11-25 12:55:19,220 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-402caeedd9b94e568a24afc6a10746d3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/testCompactionWithHFileLink=b003b003481e082b6bae5bad39b1e617-402caeedd9b94e568a24afc6a10746d3 2023-11-25 12:55:19,220 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-25 12:55:19,221 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/2bcf9de2ddd54a61b4ed312525e7e6b6_SeqId_34_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/family1/2bcf9de2ddd54a61b4ed312525e7e6b6_SeqId_34_ 2023-11-25 12:55:19,223 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-25 12:55:19,224 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1960 sec 2023-11-25 12:55:19,557 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/.tmp/family2/d999f217bd41472bb760e416b6e56b54 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/d999f217bd41472bb760e416b6e56b54 2023-11-25 12:55:19,561 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 67ff462843156320a06b388981969e08/family2 of 67ff462843156320a06b388981969e08 into d999f217bd41472bb760e416b6e56b54(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:55:19,561 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:55:19,561 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08., storeName=67ff462843156320a06b388981969e08/family2, priority=12, startTime=1700916916686; duration=0sec 2023-11-25 12:55:19,561 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:55:19,614 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-ed5e90748066410499e8750ef2575697, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-527a6b3539da400199c0149e8751990d, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-ed7c3e9141634382a3bff703fe6853db, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-c6bc3e563e3043f68c114803466cb070] to archive 2023-11-25 12:55:19,615 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:19,616 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-ed5e90748066410499e8750ef2575697 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-ed5e90748066410499e8750ef2575697 2023-11-25 12:55:19,618 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-527a6b3539da400199c0149e8751990d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-527a6b3539da400199c0149e8751990d 2023-11-25 12:55:19,619 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-ed7c3e9141634382a3bff703fe6853db to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-ed7c3e9141634382a3bff703fe6853db 2023-11-25 12:55:19,620 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-c6bc3e563e3043f68c114803466cb070 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/family2/testCompactionWithHFileLink=67ff462843156320a06b388981969e08-c6bc3e563e3043f68c114803466cb070 2023-11-25 12:55:20,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-25 12:55:20,136 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-25 12:55:20,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:20,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:20,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:20,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:20,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-25 12:55:20,148 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-25 12:55:20,148 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:20,148 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-25 12:55:20,148 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-25 12:55:20,149 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:20,149 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:20,150 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:20,150 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:20,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:20,150 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:20,150 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:20,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:20,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:20,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:20,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:20,151 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-25 12:55:20,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-25 12:55:20,151 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-25 12:55:20,151 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:20,152 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-25 12:55:20,152 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:20,152 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. started... 2023-11-25 12:55:20,152 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:55:20,152 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:20,152 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:20,154 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 429309f3707a667a7044d0fa7d8d576d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-25 12:55:20,154 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. started... 2023-11-25 12:55:20,152 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:20,154 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c902f29bb39df121448280b255efeb4d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-25 12:55:20,154 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. started... 2023-11-25 12:55:20,154 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 28de3526844060bb212fbaedf7d89ec8 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-25 12:55:20,180 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125d59e952bdafd4760a8b7f1c61737904b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231125d59e952bdafd4760a8b7f1c61737904b 2023-11-25 12:55:20,184 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family1/ccc9e0ec152e45a9935a07e54fa7e191 2023-11-25 12:55:20,195 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125a2cae5946ee3438f8ad5ba54f77864db to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231125a2cae5946ee3438f8ad5ba54f77864db 2023-11-25 12:55:20,200 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family2/c3ae5f03af3b47cc91717b8999d26b64 2023-11-25 12:55:20,204 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family1/ccc9e0ec152e45a9935a07e54fa7e191 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/ccc9e0ec152e45a9935a07e54fa7e191 2023-11-25 12:55:20,207 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/ccc9e0ec152e45a9935a07e54fa7e191, entries=4, sequenceid=5, filesize=5.4 K 2023-11-25 12:55:20,208 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family2/c3ae5f03af3b47cc91717b8999d26b64 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/c3ae5f03af3b47cc91717b8999d26b64 2023-11-25 12:55:20,211 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/c3ae5f03af3b47cc91717b8999d26b64, entries=2, sequenceid=5, filesize=5.1 K 2023-11-25 12:55:20,212 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 429309f3707a667a7044d0fa7d8d576d in 58ms, sequenceid=5, compaction requested=false 2023-11-25 12:55:20,212 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-25 12:55:20,213 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 429309f3707a667a7044d0fa7d8d576d: 2023-11-25 12:55:20,213 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:20,213 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:55:20,578 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125d714915cab5f46f5a39e819851dae93f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231125d714915cab5f46f5a39e819851dae93f 2023-11-25 12:55:20,583 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125d0d3325f01a94edda4c73fd3ccb32d34 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231125d0d3325f01a94edda4c73fd3ccb32d34 2023-11-25 12:55:20,983 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family1/823d3176e34f45219cc3b5c75fca708b 2023-11-25 12:55:20,988 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family1/a5ff51642a704e7abfc3b2a934b4ec3a 2023-11-25 12:55:20,999 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125a0b23751234f4ca4b4d2aac200861b04 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231125a0b23751234f4ca4b4d2aac200861b04 2023-11-25 12:55:21,005 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family2/eb93d9b432ee4fff892c907aac3e9925 2023-11-25 12:55:21,020 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:55:21,020 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f474d3e to 127.0.0.1:63200 2023-11-25 12:55:21,020 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:55:21,020 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:55:21,020 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21d878dd to 127.0.0.1:63200 2023-11-25 12:55:21,020 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:55:21,021 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:55:21,021 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x390d627a to 127.0.0.1:63200 2023-11-25 12:55:21,021 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:55:21,023 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family1/823d3176e34f45219cc3b5c75fca708b as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/823d3176e34f45219cc3b5c75fca708b 2023-11-25 12:55:21,027 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/823d3176e34f45219cc3b5c75fca708b, entries=4, sequenceid=5, filesize=5.4 K 2023-11-25 12:55:21,028 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family2/eb93d9b432ee4fff892c907aac3e9925 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/eb93d9b432ee4fff892c907aac3e9925 2023-11-25 12:55:21,031 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/eb93d9b432ee4fff892c907aac3e9925, entries=2, sequenceid=5, filesize=5.1 K 2023-11-25 12:55:21,032 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c902f29bb39df121448280b255efeb4d in 878ms, sequenceid=5, compaction requested=false 2023-11-25 12:55:21,032 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c902f29bb39df121448280b255efeb4d: 2023-11-25 12:55:21,032 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:21,032 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:55:21,403 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125bf1498cc21f344d6afb7b2be9b5f419e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231125bf1498cc21f344d6afb7b2be9b5f419e 2023-11-25 12:55:21,413 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family2/d5175edb4a5d405192d9af23e43b8601 2023-11-25 12:55:21,418 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family1/a5ff51642a704e7abfc3b2a934b4ec3a as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/a5ff51642a704e7abfc3b2a934b4ec3a 2023-11-25 12:55:21,422 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/a5ff51642a704e7abfc3b2a934b4ec3a, entries=4, sequenceid=5, filesize=5.4 K 2023-11-25 12:55:21,423 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family2/d5175edb4a5d405192d9af23e43b8601 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/d5175edb4a5d405192d9af23e43b8601 2023-11-25 12:55:21,427 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/d5175edb4a5d405192d9af23e43b8601, entries=2, sequenceid=5, filesize=5.1 K 2023-11-25 12:55:21,428 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 28de3526844060bb212fbaedf7d89ec8 in 1274ms, sequenceid=5, compaction requested=false 2023-11-25 12:55:21,428 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 28de3526844060bb212fbaedf7d89ec8: 2023-11-25 12:55:21,428 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:21,429 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:55:21,429 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:55:21,429 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:21,429 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-25 12:55:21,429 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-25 12:55:21,431 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:21,431 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:21,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:21,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:21,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:21,432 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:21,432 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:21,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:21,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:21,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:21,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:21,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:21,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-25 12:55:21,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76ec02d1[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:21,434 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-25 12:55:21,434 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:21,435 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:21,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:21,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:21,435 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-25 12:55:21,436 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-25 12:55:21,436 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:21,437 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-25 12:55:21,437 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:21,438 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-25 12:55:21,438 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:21,438 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-25 12:55:21,438 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:21,438 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-25 12:55:21,438 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:21,438 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:21,438 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-25 12:55:21,438 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:21,446 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:21,446 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:21,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:21,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:21,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:21,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:21,446 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:21,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:21,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:21,447 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:21,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:21,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:21,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:21,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:21,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:21,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:21,450 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:21,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:21,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:21,453 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:21,453 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:21,453 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:21,453 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:21,453 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:21,453 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:21,453 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:21,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-25 12:55:21,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:21,453 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:21,453 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:21,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:21,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-25 12:55:21,453 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:21,454 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:21,453 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:21,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:21,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:21,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:21,554 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:21,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:21,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:21,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:21,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:21,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:21,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:21,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-25 12:55:21,561 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-25 12:55:21,561 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:21,561 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-25 12:55:21,561 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-25 12:55:21,562 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:21,562 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:21,563 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:21,563 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:21,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:21,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:21,563 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:21,563 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:21,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:21,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:21,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:21,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:21,564 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-25 12:55:21,568 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-25 12:55:21,568 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-25 12:55:21,568 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-25 12:55:21,568 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:21,568 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-25 12:55:21,569 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:21,569 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. started... 2023-11-25 12:55:21,569 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:21,569 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 429309f3707a667a7044d0fa7d8d576d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-25 12:55:21,569 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. started... 2023-11-25 12:55:21,569 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:55:21,569 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:21,569 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c902f29bb39df121448280b255efeb4d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-25 12:55:21,569 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:21,569 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. started... 2023-11-25 12:55:21,569 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 28de3526844060bb212fbaedf7d89ec8 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-25 12:55:21,990 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311251b0c513202c3474c81b005b6c92cd446 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311251b0c513202c3474c81b005b6c92cd446 2023-11-25 12:55:21,992 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125be5f8916cc284c4489d5ab62ed0dace0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231125be5f8916cc284c4489d5ab62ed0dace0 2023-11-25 12:55:21,992 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311255d7af6d9c4a24e5288fdd15a63538fb7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311255d7af6d9c4a24e5288fdd15a63538fb7 2023-11-25 12:55:21,997 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family1/68dc9965b53546119bee98cced2a8221 2023-11-25 12:55:21,998 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family1/e13333d1f45e4c6cbf3af2792a9451dd 2023-11-25 12:55:21,999 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family1/73f26dce687f4b83a568d4d8871dee8b 2023-11-25 12:55:22,041 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125c48c5d78ab44481096cba370e0ba0c14 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231125c48c5d78ab44481096cba370e0ba0c14 2023-11-25 12:55:22,042 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125bd40836d88b1442d828aa61213d3eae7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231125bd40836d88b1442d828aa61213d3eae7 2023-11-25 12:55:22,043 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125e1862595689844f2b6f49a712441e37f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231125e1862595689844f2b6f49a712441e37f 2023-11-25 12:55:22,056 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family2/02239446c2314af9a8711af1cb59fb2b 2023-11-25 12:55:22,056 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family2/3f8aa5b3a06147f585c48983995ea792 2023-11-25 12:55:22,058 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family2/9b1f006655bc49bcbf76c01db9447739 2023-11-25 12:55:22,061 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family1/73f26dce687f4b83a568d4d8871dee8b as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/73f26dce687f4b83a568d4d8871dee8b 2023-11-25 12:55:22,061 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family1/e13333d1f45e4c6cbf3af2792a9451dd as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/e13333d1f45e4c6cbf3af2792a9451dd 2023-11-25 12:55:22,062 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family1/68dc9965b53546119bee98cced2a8221 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/68dc9965b53546119bee98cced2a8221 2023-11-25 12:55:22,065 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/73f26dce687f4b83a568d4d8871dee8b, entries=4, sequenceid=9, filesize=5.4 K 2023-11-25 12:55:22,066 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family2/3f8aa5b3a06147f585c48983995ea792 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/3f8aa5b3a06147f585c48983995ea792 2023-11-25 12:55:22,067 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/68dc9965b53546119bee98cced2a8221, entries=4, sequenceid=9, filesize=5.4 K 2023-11-25 12:55:22,067 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/e13333d1f45e4c6cbf3af2792a9451dd, entries=4, sequenceid=9, filesize=5.4 K 2023-11-25 12:55:22,068 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family2/02239446c2314af9a8711af1cb59fb2b as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/02239446c2314af9a8711af1cb59fb2b 2023-11-25 12:55:22,068 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family2/9b1f006655bc49bcbf76c01db9447739 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/9b1f006655bc49bcbf76c01db9447739 2023-11-25 12:55:22,070 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/3f8aa5b3a06147f585c48983995ea792, entries=2, sequenceid=9, filesize=5.1 K 2023-11-25 12:55:22,070 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 28de3526844060bb212fbaedf7d89ec8 in 501ms, sequenceid=9, compaction requested=false 2023-11-25 12:55:22,071 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 28de3526844060bb212fbaedf7d89ec8: 2023-11-25 12:55:22,071 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:22,071 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:55:22,072 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/9b1f006655bc49bcbf76c01db9447739, entries=2, sequenceid=9, filesize=5.1 K 2023-11-25 12:55:22,072 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/02239446c2314af9a8711af1cb59fb2b, entries=2, sequenceid=9, filesize=5.1 K 2023-11-25 12:55:22,073 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c902f29bb39df121448280b255efeb4d in 504ms, sequenceid=9, compaction requested=false 2023-11-25 12:55:22,073 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 429309f3707a667a7044d0fa7d8d576d in 504ms, sequenceid=9, compaction requested=false 2023-11-25 12:55:22,073 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c902f29bb39df121448280b255efeb4d: 2023-11-25 12:55:22,073 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 429309f3707a667a7044d0fa7d8d576d: 2023-11-25 12:55:22,073 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:22,073 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:22,073 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:55:22,074 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:55:22,074 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:55:22,074 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,074 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-25 12:55:22,074 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-25 12:55:22,075 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,075 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:22,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:22,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:22,076 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:22,076 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:22,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:22,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:22,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:22,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:22,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-25 12:55:22,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51d4a4b4[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:22,077 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-25 12:55:22,077 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:22,080 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:22,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:22,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:22,080 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-25 12:55:22,080 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-25 12:55:22,080 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:22,080 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,080 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:22,081 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,081 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-25 12:55:22,081 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:22,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:22,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:22,081 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-25 12:55:22,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:22,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:22,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:22,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:22,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:22,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:22,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-25 12:55:22,084 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-25 12:55:22,084 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:22,084 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:22,084 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-25 12:55:22,084 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:22,085 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:22,085 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:22,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:22,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:22,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:22,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:22,086 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:22,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:22,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:22,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:22,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:22,086 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:22,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:22,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:22,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:22,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:22,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:22,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,092 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,098 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,098 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:22,098 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:22,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:22,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-25 12:55:22,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:22,098 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:22,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:22,098 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:22,098 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:22,098 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,099 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:22,099 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:22,099 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:22,099 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:22,099 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:22,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:22,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:22,199 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:22,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:22,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:22,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:22,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:22,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:22,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:22,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-25 12:55:22,207 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-25 12:55:22,207 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:22,207 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-25 12:55:22,207 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-25 12:55:22,207 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:22,207 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:22,209 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,209 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:22,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:22,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:22,209 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:22,210 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:22,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:22,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:22,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:22,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:22,210 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-25 12:55:22,210 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-25 12:55:22,211 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-25 12:55:22,211 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-25 12:55:22,211 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:22,211 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-25 12:55:22,211 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:22,211 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:22,211 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. started... 2023-11-25 12:55:22,211 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. started... 2023-11-25 12:55:22,211 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c902f29bb39df121448280b255efeb4d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-25 12:55:22,211 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 429309f3707a667a7044d0fa7d8d576d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-25 12:55:22,212 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:55:22,212 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:22,212 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:22,212 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. started... 2023-11-25 12:55:22,212 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 28de3526844060bb212fbaedf7d89ec8 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-25 12:55:22,236 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125aeeeeafa87b84836888e30e95bd9d11d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231125aeeeeafa87b84836888e30e95bd9d11d 2023-11-25 12:55:22,236 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112524187df5f0a14684b4702398f64d352b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023112524187df5f0a14684b4702398f64d352b 2023-11-25 12:55:22,256 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112583c98383e700434cbc9d14fcdca9b1d7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112583c98383e700434cbc9d14fcdca9b1d7 2023-11-25 12:55:22,267 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family1/66d8fd9c8d064fb9bd0c9b53462e20e3 2023-11-25 12:55:22,283 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125b0d6a3b14c0d45f59a9a1cbdcbef1c11 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231125b0d6a3b14c0d45f59a9a1cbdcbef1c11 2023-11-25 12:55:22,291 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family2/289e03cd0f2b4cd2b99fb0dd3bcb3987 2023-11-25 12:55:22,295 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family1/66d8fd9c8d064fb9bd0c9b53462e20e3 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/66d8fd9c8d064fb9bd0c9b53462e20e3 2023-11-25 12:55:22,299 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/66d8fd9c8d064fb9bd0c9b53462e20e3, entries=4, sequenceid=13, filesize=5.4 K 2023-11-25 12:55:22,300 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family2/289e03cd0f2b4cd2b99fb0dd3bcb3987 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/289e03cd0f2b4cd2b99fb0dd3bcb3987 2023-11-25 12:55:22,304 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/289e03cd0f2b4cd2b99fb0dd3bcb3987, entries=2, sequenceid=13, filesize=5.1 K 2023-11-25 12:55:22,305 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 28de3526844060bb212fbaedf7d89ec8 in 93ms, sequenceid=13, compaction requested=true 2023-11-25 12:55:22,305 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 28de3526844060bb212fbaedf7d89ec8: 2023-11-25 12:55:22,305 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:22,305 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:55:22,654 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family1/938337415e6445e39e3c355b8cd6b13a 2023-11-25 12:55:22,654 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family1/5b5cd6e801a64aee8fb10e76ff2f99f7 2023-11-25 12:55:22,667 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311250ba3d906613d4b48a9733371368446fe to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311250ba3d906613d4b48a9733371368446fe 2023-11-25 12:55:23,067 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125a7a9b94336c74ee994ca3f3ca937fa8a to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231125a7a9b94336c74ee994ca3f3ca937fa8a 2023-11-25 12:55:23,072 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family2/be082f085dec478abfc56672b01cce77 2023-11-25 12:55:23,075 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family1/5b5cd6e801a64aee8fb10e76ff2f99f7 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/5b5cd6e801a64aee8fb10e76ff2f99f7 2023-11-25 12:55:23,078 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/5b5cd6e801a64aee8fb10e76ff2f99f7, entries=4, sequenceid=13, filesize=5.4 K 2023-11-25 12:55:23,079 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family2/be082f085dec478abfc56672b01cce77 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/be082f085dec478abfc56672b01cce77 2023-11-25 12:55:23,081 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/be082f085dec478abfc56672b01cce77, entries=2, sequenceid=13, filesize=5.1 K 2023-11-25 12:55:23,082 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c902f29bb39df121448280b255efeb4d in 871ms, sequenceid=13, compaction requested=true 2023-11-25 12:55:23,082 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c902f29bb39df121448280b255efeb4d: 2023-11-25 12:55:23,082 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:23,082 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:55:23,472 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family2/9cdd8675849440d8b34c3c3447cf9ec9 2023-11-25 12:55:23,478 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family1/938337415e6445e39e3c355b8cd6b13a as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/938337415e6445e39e3c355b8cd6b13a 2023-11-25 12:55:23,481 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/938337415e6445e39e3c355b8cd6b13a, entries=4, sequenceid=13, filesize=5.4 K 2023-11-25 12:55:23,482 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family2/9cdd8675849440d8b34c3c3447cf9ec9 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/9cdd8675849440d8b34c3c3447cf9ec9 2023-11-25 12:55:23,486 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/9cdd8675849440d8b34c3c3447cf9ec9, entries=2, sequenceid=13, filesize=5.1 K 2023-11-25 12:55:23,487 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 429309f3707a667a7044d0fa7d8d576d in 1276ms, sequenceid=13, compaction requested=true 2023-11-25 12:55:23,487 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 429309f3707a667a7044d0fa7d8d576d: 2023-11-25 12:55:23,487 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:23,487 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:55:23,487 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:55:23,487 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,487 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-25 12:55:23,487 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-25 12:55:23,489 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:23,489 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:23,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:23,490 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:23,490 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:23,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:23,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:23,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:23,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:23,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-25 12:55:23,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c454e3a[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:23,492 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-25 12:55:23,492 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:23,493 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:23,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:23,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:23,493 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-25 12:55:23,493 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-25 12:55:23,493 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:23,493 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,493 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:23,495 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,495 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-25 12:55:23,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:23,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:23,495 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:23,495 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-25 12:55:23,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:23,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:23,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:23,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:23,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:23,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:23,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-25 12:55:23,498 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-25 12:55:23,498 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:23,498 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:23,498 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-25 12:55:23,498 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:23,503 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:23,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:23,503 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:23,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:23,503 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:23,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:23,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:23,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:23,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:23,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:23,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:23,503 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:23,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:23,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:23,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:23,505 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:23,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:23,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,507 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:23,507 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:23,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:23,507 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:23,507 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:23,507 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:23,508 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,508 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:23,508 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:23,508 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:23,508 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:23,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-25 12:55:23,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:23,508 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:23,508 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:23,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:23,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:23,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-25 12:55:23,608 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:23,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:23,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:23,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:23,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:23,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:23,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:23,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-25 12:55:23,615 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-25 12:55:23,615 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:23,615 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-25 12:55:23,615 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-25 12:55:23,615 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:23,615 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:23,617 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:23,617 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:23,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:23,617 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:23,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:23,617 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:23,617 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:23,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:23,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:23,618 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-25 12:55:23,618 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-25 12:55:23,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-25 12:55:23,618 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-25 12:55:23,618 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:23,618 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-25 12:55:23,618 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:23,618 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:23,619 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. started... 2023-11-25 12:55:23,618 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:55:23,619 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:23,619 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:23,619 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. started... 2023-11-25 12:55:23,619 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. started... 2023-11-25 12:55:23,619 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c902f29bb39df121448280b255efeb4d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-25 12:55:23,619 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 429309f3707a667a7044d0fa7d8d576d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-25 12:55:23,619 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 28de3526844060bb212fbaedf7d89ec8 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-25 12:55:23,633 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125663cc30845644d05a13232b831094ad6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231125663cc30845644d05a13232b831094ad6 2023-11-25 12:55:23,638 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family1/7ab176d005444f458c03fdc7baac69e5 2023-11-25 12:55:24,035 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125c8f7bbf571e84ec6a37cd5d820ae54ef to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231125c8f7bbf571e84ec6a37cd5d820ae54ef 2023-11-25 12:55:24,035 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125c9c1302b6f7644ed83ff21922512eaed to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231125c9c1302b6f7644ed83ff21922512eaed 2023-11-25 12:55:24,053 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311254655ee1f03e547af8d90bb0c3ac94770 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311254655ee1f03e547af8d90bb0c3ac94770 2023-11-25 12:55:24,057 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family2/d4a7300ef2e346e989222a7034a719c0 2023-11-25 12:55:24,060 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family1/7ab176d005444f458c03fdc7baac69e5 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/7ab176d005444f458c03fdc7baac69e5 2023-11-25 12:55:24,064 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/7ab176d005444f458c03fdc7baac69e5, entries=4, sequenceid=17, filesize=5.4 K 2023-11-25 12:55:24,064 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family2/d4a7300ef2e346e989222a7034a719c0 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/d4a7300ef2e346e989222a7034a719c0 2023-11-25 12:55:24,068 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/d4a7300ef2e346e989222a7034a719c0, entries=2, sequenceid=17, filesize=5.1 K 2023-11-25 12:55:24,068 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c902f29bb39df121448280b255efeb4d in 449ms, sequenceid=17, compaction requested=true 2023-11-25 12:55:24,068 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c902f29bb39df121448280b255efeb4d: 2023-11-25 12:55:24,068 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:24,069 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:55:24,440 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family1/3cef4fe24ccd40dcb7d29ec7105ddba0 2023-11-25 12:55:24,440 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family1/5e86f09b03da4de492ff54bf488d801c 2023-11-25 12:55:24,454 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311254a24f457ea534456bfc67c92760f2ddf to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311254a24f457ea534456bfc67c92760f2ddf 2023-11-25 12:55:24,677 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-25 12:55:24,855 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311256b24d8873713493293decb4e32b9dc39 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311256b24d8873713493293decb4e32b9dc39 2023-11-25 12:55:24,858 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family2/ae4deabb99ae444e8993c7dde0fb38eb 2023-11-25 12:55:24,862 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family1/3cef4fe24ccd40dcb7d29ec7105ddba0 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/3cef4fe24ccd40dcb7d29ec7105ddba0 2023-11-25 12:55:24,865 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/3cef4fe24ccd40dcb7d29ec7105ddba0, entries=4, sequenceid=17, filesize=5.4 K 2023-11-25 12:55:24,866 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family2/ae4deabb99ae444e8993c7dde0fb38eb as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/ae4deabb99ae444e8993c7dde0fb38eb 2023-11-25 12:55:24,870 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/ae4deabb99ae444e8993c7dde0fb38eb, entries=2, sequenceid=17, filesize=5.1 K 2023-11-25 12:55:24,870 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 28de3526844060bb212fbaedf7d89ec8 in 1251ms, sequenceid=17, compaction requested=true 2023-11-25 12:55:24,870 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 28de3526844060bb212fbaedf7d89ec8: 2023-11-25 12:55:24,870 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:24,870 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:55:25,260 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family2/0592cf2b28094a8ea6fe6a7c816631bb 2023-11-25 12:55:25,264 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family1/5e86f09b03da4de492ff54bf488d801c as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/5e86f09b03da4de492ff54bf488d801c 2023-11-25 12:55:25,268 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/5e86f09b03da4de492ff54bf488d801c, entries=4, sequenceid=17, filesize=5.4 K 2023-11-25 12:55:25,268 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family2/0592cf2b28094a8ea6fe6a7c816631bb as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/0592cf2b28094a8ea6fe6a7c816631bb 2023-11-25 12:55:25,272 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/0592cf2b28094a8ea6fe6a7c816631bb, entries=2, sequenceid=17, filesize=5.1 K 2023-11-25 12:55:25,273 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 429309f3707a667a7044d0fa7d8d576d in 1653ms, sequenceid=17, compaction requested=true 2023-11-25 12:55:25,273 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 429309f3707a667a7044d0fa7d8d576d: 2023-11-25 12:55:25,273 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:25,273 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:55:25,273 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:55:25,273 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,273 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-25 12:55:25,273 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-25 12:55:25,275 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,275 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:25,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:25,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:25,275 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:25,275 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:25,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:25,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:25,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:25,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:25,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-25 12:55:25,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bc74cac[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:25,277 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-25 12:55:25,277 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:25,278 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:25,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:25,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:25,278 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-25 12:55:25,278 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-25 12:55:25,278 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:25,278 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,278 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:25,280 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-25 12:55:25,280 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:25,280 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,280 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-25 12:55:25,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:25,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:25,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:25,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:25,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:25,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:25,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-25 12:55:25,282 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-25 12:55:25,282 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:25,282 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:25,282 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-25 12:55:25,282 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:25,284 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:25,284 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:25,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:25,284 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:25,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:25,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:25,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:25,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:25,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:25,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:25,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:25,285 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:25,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:25,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:25,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:25,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,292 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,294 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,294 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:25,294 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:25,294 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,294 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:25,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-25 12:55:25,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:25,294 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:25,294 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:25,294 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:25,295 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:25,295 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:25,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:25,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:25,295 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:25,295 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:25,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:25,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:25,395 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:25,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:25,409 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:25,421 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:25,430 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:25,431 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:25,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:25,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:25,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-25 12:55:25,462 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-25 12:55:25,462 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:25,462 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-25 12:55:25,462 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-25 12:55:25,462 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:25,462 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:25,463 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,463 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:25,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:25,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:25,464 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:25,464 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:25,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:25,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:25,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:25,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:25,465 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-25 12:55:25,465 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-25 12:55:25,465 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-25 12:55:25,465 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-25 12:55:25,465 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:25,465 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-25 12:55:25,468 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:25,468 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. started... 2023-11-25 12:55:25,468 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 429309f3707a667a7044d0fa7d8d576d 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-25 12:55:25,469 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:25,469 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. started... 2023-11-25 12:55:25,469 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:55:25,469 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c902f29bb39df121448280b255efeb4d 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-25 12:55:25,469 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:25,469 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. started... 2023-11-25 12:55:25,469 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:25,469 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 28de3526844060bb212fbaedf7d89ec8 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-25 12:55:25,499 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family1/302b9860cad7416da2d3924b23125a0f 2023-11-25 12:55:25,502 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 302b9860cad7416da2d3924b23125a0f 2023-11-25 12:55:25,921 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family2/e6c0e2920f464803a59fdcc2e2c00b52 2023-11-25 12:55:25,924 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6c0e2920f464803a59fdcc2e2c00b52 2023-11-25 12:55:25,924 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family1/302b9860cad7416da2d3924b23125a0f as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/302b9860cad7416da2d3924b23125a0f 2023-11-25 12:55:25,927 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 302b9860cad7416da2d3924b23125a0f 2023-11-25 12:55:25,927 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/302b9860cad7416da2d3924b23125a0f, entries=3, sequenceid=23, filesize=5.0 K 2023-11-25 12:55:25,928 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family2/e6c0e2920f464803a59fdcc2e2c00b52 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/e6c0e2920f464803a59fdcc2e2c00b52 2023-11-25 12:55:25,931 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6c0e2920f464803a59fdcc2e2c00b52 2023-11-25 12:55:25,931 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/e6c0e2920f464803a59fdcc2e2c00b52, entries=1, sequenceid=23, filesize=5.0 K 2023-11-25 12:55:25,932 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c902f29bb39df121448280b255efeb4d in 463ms, sequenceid=23, compaction requested=true 2023-11-25 12:55:25,932 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c902f29bb39df121448280b255efeb4d: 2023-11-25 12:55:25,932 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:25,932 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:55:26,289 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family1/cdf0bab634124a15a5188a87d2235222 2023-11-25 12:55:26,293 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cdf0bab634124a15a5188a87d2235222 2023-11-25 12:55:26,295 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family1/42bd32c9e7e5450cb4062e5a1c9c0211 2023-11-25 12:55:26,298 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42bd32c9e7e5450cb4062e5a1c9c0211 2023-11-25 12:55:26,311 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family2/8b3d1c39fff041bb86d1ab8c307190cb 2023-11-25 12:55:26,313 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b3d1c39fff041bb86d1ab8c307190cb 2023-11-25 12:55:26,314 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family1/42bd32c9e7e5450cb4062e5a1c9c0211 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/42bd32c9e7e5450cb4062e5a1c9c0211 2023-11-25 12:55:26,317 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42bd32c9e7e5450cb4062e5a1c9c0211 2023-11-25 12:55:26,318 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/42bd32c9e7e5450cb4062e5a1c9c0211, entries=3, sequenceid=23, filesize=5.0 K 2023-11-25 12:55:26,318 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family2/8b3d1c39fff041bb86d1ab8c307190cb as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/8b3d1c39fff041bb86d1ab8c307190cb 2023-11-25 12:55:26,321 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b3d1c39fff041bb86d1ab8c307190cb 2023-11-25 12:55:26,321 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/8b3d1c39fff041bb86d1ab8c307190cb, entries=1, sequenceid=23, filesize=5.0 K 2023-11-25 12:55:26,322 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 28de3526844060bb212fbaedf7d89ec8 in 853ms, sequenceid=23, compaction requested=true 2023-11-25 12:55:26,322 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 28de3526844060bb212fbaedf7d89ec8: 2023-11-25 12:55:26,322 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:26,322 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:55:27,105 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family2/76a7a4a2f4c84201a65647e3cb20921b 2023-11-25 12:55:27,109 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76a7a4a2f4c84201a65647e3cb20921b 2023-11-25 12:55:27,110 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family1/cdf0bab634124a15a5188a87d2235222 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/cdf0bab634124a15a5188a87d2235222 2023-11-25 12:55:27,114 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cdf0bab634124a15a5188a87d2235222 2023-11-25 12:55:27,114 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/cdf0bab634124a15a5188a87d2235222, entries=3, sequenceid=23, filesize=5.0 K 2023-11-25 12:55:27,115 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family2/76a7a4a2f4c84201a65647e3cb20921b as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/76a7a4a2f4c84201a65647e3cb20921b 2023-11-25 12:55:27,118 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76a7a4a2f4c84201a65647e3cb20921b 2023-11-25 12:55:27,118 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/76a7a4a2f4c84201a65647e3cb20921b, entries=1, sequenceid=23, filesize=5.0 K 2023-11-25 12:55:27,119 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 429309f3707a667a7044d0fa7d8d576d in 1651ms, sequenceid=23, compaction requested=true 2023-11-25 12:55:27,119 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 429309f3707a667a7044d0fa7d8d576d: 2023-11-25 12:55:27,119 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:27,119 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:55:27,119 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:55:27,119 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:27,119 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-25 12:55:27,120 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-25 12:55:27,121 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:27,121 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:27,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:27,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:27,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:27,122 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:27,122 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:27,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:27,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:27,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:27,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:27,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:27,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-25 12:55:27,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dab358f[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:27,123 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-25 12:55:27,123 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:27,124 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:27,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:27,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:27,124 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-25 12:55:27,124 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-25 12:55:27,124 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:27,125 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:27,125 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:27,127 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-25 12:55:27,127 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:27,127 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:27,127 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-25 12:55:27,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:27,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:27,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:27,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:27,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:27,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:27,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:27,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:27,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:27,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:27,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:27,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-25 12:55:27,130 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-25 12:55:27,130 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:27,130 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:27,130 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-25 12:55:27,130 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:27,132 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:27,132 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:27,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:27,132 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:27,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:27,132 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:27,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:27,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:27,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:27,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:27,135 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:27,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:27,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-25 12:55:27,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:27,137 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:27,138 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:27,138 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:27,138 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:27,138 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-25 12:55:27,138 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:27,138 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:27,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:27,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:27,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-25 12:55:27,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:27,138 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:27,138 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-25 12:55:27,138 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-25 12:55:27,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:27,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:27,138 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:27,138 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:27,238 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:27,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:27,240 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:55:27,240 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): 429309f3707a667a7044d0fa7d8d576d/family1 is initiating major compaction (all files) 2023-11-25 12:55:27,240 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:55:27,240 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:55:27,240 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of 429309f3707a667a7044d0fa7d8d576d/family1 in ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:27,240 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/ccc9e0ec152e45a9935a07e54fa7e191, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/e13333d1f45e4c6cbf3af2792a9451dd, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/938337415e6445e39e3c355b8cd6b13a, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/5e86f09b03da4de492ff54bf488d801c, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/cdf0bab634124a15a5188a87d2235222] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp, totalSize=26.6 K 2023-11-25 12:55:27,241 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting ccc9e0ec152e45a9935a07e54fa7e191, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916920143 2023-11-25 12:55:27,241 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting e13333d1f45e4c6cbf3af2792a9451dd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916921557 2023-11-25 12:55:27,242 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 938337415e6445e39e3c355b8cd6b13a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916922201 2023-11-25 12:55:27,242 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 5e86f09b03da4de492ff54bf488d801c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916923610 2023-11-25 12:55:27,242 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting cdf0bab634124a15a5188a87d2235222, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-25 12:55:27,252 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): 429309f3707a667a7044d0fa7d8d576d#family1#compaction#148 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:55:27,668 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023112538de1ef586194153b012ad9477480a8c_del 2023-11-25 12:55:27,668 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112538de1ef586194153b012ad9477480a8c_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023112538de1ef586194153b012ad9477480a8c_del 2023-11-25 12:55:28,080 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8652503819f94a0e9108a6c50f608d59 2023-11-25 12:55:28,080 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family1/8652503819f94a0e9108a6c50f608d59 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/8652503819f94a0e9108a6c50f608d59 2023-11-25 12:55:28,084 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8652503819f94a0e9108a6c50f608d59 2023-11-25 12:55:28,085 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 429309f3707a667a7044d0fa7d8d576d/family1 of 429309f3707a667a7044d0fa7d8d576d into 8652503819f94a0e9108a6c50f608d59(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:55:28,085 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for 429309f3707a667a7044d0fa7d8d576d: 2023-11-25 12:55:28,085 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:55:28,085 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): 429309f3707a667a7044d0fa7d8d576d/family2 is initiating major compaction (all files) 2023-11-25 12:55:28,085 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:55:28,085 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:55:28,085 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of 429309f3707a667a7044d0fa7d8d576d/family2 in ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:55:28,086 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/c3ae5f03af3b47cc91717b8999d26b64, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/02239446c2314af9a8711af1cb59fb2b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/9cdd8675849440d8b34c3c3447cf9ec9, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/0592cf2b28094a8ea6fe6a7c816631bb, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/76a7a4a2f4c84201a65647e3cb20921b] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp, totalSize=25.3 K 2023-11-25 12:55:28,086 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting c3ae5f03af3b47cc91717b8999d26b64, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916920143 2023-11-25 12:55:28,086 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 02239446c2314af9a8711af1cb59fb2b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916921557 2023-11-25 12:55:28,087 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 9cdd8675849440d8b34c3c3447cf9ec9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916922201 2023-11-25 12:55:28,087 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 0592cf2b28094a8ea6fe6a7c816631bb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916923610 2023-11-25 12:55:28,087 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 76a7a4a2f4c84201a65647e3cb20921b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-25 12:55:28,096 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): 429309f3707a667a7044d0fa7d8d576d#family2#compaction#149 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:55:28,113 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/ccc9e0ec152e45a9935a07e54fa7e191, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/e13333d1f45e4c6cbf3af2792a9451dd, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/938337415e6445e39e3c355b8cd6b13a, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/5e86f09b03da4de492ff54bf488d801c, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/cdf0bab634124a15a5188a87d2235222] to archive 2023-11-25 12:55:28,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:28,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/ccc9e0ec152e45a9935a07e54fa7e191 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/ccc9e0ec152e45a9935a07e54fa7e191 2023-11-25 12:55:28,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/e13333d1f45e4c6cbf3af2792a9451dd to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/e13333d1f45e4c6cbf3af2792a9451dd 2023-11-25 12:55:28,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/938337415e6445e39e3c355b8cd6b13a to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/938337415e6445e39e3c355b8cd6b13a 2023-11-25 12:55:28,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/5e86f09b03da4de492ff54bf488d801c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/5e86f09b03da4de492ff54bf488d801c 2023-11-25 12:55:28,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/cdf0bab634124a15a5188a87d2235222 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/cdf0bab634124a15a5188a87d2235222 2023-11-25 12:55:28,505 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311256f6ec12c0e37483bb6f3f71f0b559199_del 2023-11-25 12:55:28,506 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311256f6ec12c0e37483bb6f3f71f0b559199_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311256f6ec12c0e37483bb6f3f71f0b559199_del 2023-11-25 12:55:28,919 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aebb5fe30b61416a8a173597e89371f0 2023-11-25 12:55:28,920 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/.tmp/family2/aebb5fe30b61416a8a173597e89371f0 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/aebb5fe30b61416a8a173597e89371f0 2023-11-25 12:55:28,923 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aebb5fe30b61416a8a173597e89371f0 2023-11-25 12:55:28,923 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 429309f3707a667a7044d0fa7d8d576d/family2 of 429309f3707a667a7044d0fa7d8d576d into aebb5fe30b61416a8a173597e89371f0(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:55:28,924 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for 429309f3707a667a7044d0fa7d8d576d: 2023-11-25 12:55:28,924 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:55:28,924 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): c902f29bb39df121448280b255efeb4d/family1 is initiating major compaction (all files) 2023-11-25 12:55:28,924 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:55:28,924 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:55:28,925 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of c902f29bb39df121448280b255efeb4d/family1 in ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:28,925 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/823d3176e34f45219cc3b5c75fca708b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/68dc9965b53546119bee98cced2a8221, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/5b5cd6e801a64aee8fb10e76ff2f99f7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/7ab176d005444f458c03fdc7baac69e5, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/302b9860cad7416da2d3924b23125a0f] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp, totalSize=26.6 K 2023-11-25 12:55:28,925 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 823d3176e34f45219cc3b5c75fca708b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916920143 2023-11-25 12:55:28,925 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 68dc9965b53546119bee98cced2a8221, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916921557 2023-11-25 12:55:28,926 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 5b5cd6e801a64aee8fb10e76ff2f99f7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916922202 2023-11-25 12:55:28,926 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 7ab176d005444f458c03fdc7baac69e5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916923610 2023-11-25 12:55:28,926 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 302b9860cad7416da2d3924b23125a0f, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-25 12:55:28,934 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): c902f29bb39df121448280b255efeb4d#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:55:29,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/c3ae5f03af3b47cc91717b8999d26b64, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/02239446c2314af9a8711af1cb59fb2b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/9cdd8675849440d8b34c3c3447cf9ec9, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/0592cf2b28094a8ea6fe6a7c816631bb, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/76a7a4a2f4c84201a65647e3cb20921b] to archive 2023-11-25 12:55:29,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:29,022 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/c3ae5f03af3b47cc91717b8999d26b64 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/c3ae5f03af3b47cc91717b8999d26b64 2023-11-25 12:55:29,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/02239446c2314af9a8711af1cb59fb2b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/02239446c2314af9a8711af1cb59fb2b 2023-11-25 12:55:29,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/9cdd8675849440d8b34c3c3447cf9ec9 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/9cdd8675849440d8b34c3c3447cf9ec9 2023-11-25 12:55:29,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/0592cf2b28094a8ea6fe6a7c816631bb to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/0592cf2b28094a8ea6fe6a7c816631bb 2023-11-25 12:55:29,026 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/76a7a4a2f4c84201a65647e3cb20921b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family2/76a7a4a2f4c84201a65647e3cb20921b 2023-11-25 12:55:29,341 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023112596c6efa714884125a6002a7138ca61e8_del 2023-11-25 12:55:29,341 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112596c6efa714884125a6002a7138ca61e8_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023112596c6efa714884125a6002a7138ca61e8_del 2023-11-25 12:55:30,154 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9490b51c705343dfb27bf4515532dd74 2023-11-25 12:55:30,154 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family1/9490b51c705343dfb27bf4515532dd74 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/9490b51c705343dfb27bf4515532dd74 2023-11-25 12:55:30,158 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9490b51c705343dfb27bf4515532dd74 2023-11-25 12:55:30,158 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c902f29bb39df121448280b255efeb4d/family1 of c902f29bb39df121448280b255efeb4d into 9490b51c705343dfb27bf4515532dd74(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:55:30,159 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for c902f29bb39df121448280b255efeb4d: 2023-11-25 12:55:30,159 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:55:30,159 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): c902f29bb39df121448280b255efeb4d/family2 is initiating major compaction (all files) 2023-11-25 12:55:30,159 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:55:30,159 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:55:30,160 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of c902f29bb39df121448280b255efeb4d/family2 in ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:55:30,160 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/eb93d9b432ee4fff892c907aac3e9925, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/9b1f006655bc49bcbf76c01db9447739, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/be082f085dec478abfc56672b01cce77, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/d4a7300ef2e346e989222a7034a719c0, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/e6c0e2920f464803a59fdcc2e2c00b52] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp, totalSize=25.3 K 2023-11-25 12:55:30,160 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting eb93d9b432ee4fff892c907aac3e9925, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916920143 2023-11-25 12:55:30,160 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 9b1f006655bc49bcbf76c01db9447739, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916921557 2023-11-25 12:55:30,161 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting be082f085dec478abfc56672b01cce77, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916922202 2023-11-25 12:55:30,161 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting d4a7300ef2e346e989222a7034a719c0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916923610 2023-11-25 12:55:30,161 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting e6c0e2920f464803a59fdcc2e2c00b52, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-25 12:55:30,170 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): c902f29bb39df121448280b255efeb4d#family2#compaction#151 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:55:30,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/823d3176e34f45219cc3b5c75fca708b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/68dc9965b53546119bee98cced2a8221, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/5b5cd6e801a64aee8fb10e76ff2f99f7, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/7ab176d005444f458c03fdc7baac69e5, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/302b9860cad7416da2d3924b23125a0f] to archive 2023-11-25 12:55:30,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:30,215 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/823d3176e34f45219cc3b5c75fca708b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/823d3176e34f45219cc3b5c75fca708b 2023-11-25 12:55:30,216 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/68dc9965b53546119bee98cced2a8221 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/68dc9965b53546119bee98cced2a8221 2023-11-25 12:55:30,217 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/5b5cd6e801a64aee8fb10e76ff2f99f7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/5b5cd6e801a64aee8fb10e76ff2f99f7 2023-11-25 12:55:30,218 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/7ab176d005444f458c03fdc7baac69e5 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/7ab176d005444f458c03fdc7baac69e5 2023-11-25 12:55:30,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/302b9860cad7416da2d3924b23125a0f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/302b9860cad7416da2d3924b23125a0f 2023-11-25 12:55:30,577 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023112507cab3e3c57c40109fead55079a9b6fd_del 2023-11-25 12:55:30,577 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112507cab3e3c57c40109fead55079a9b6fd_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023112507cab3e3c57c40109fead55079a9b6fd_del 2023-11-25 12:55:31,390 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b620d3361964eca823d598034d2e2a5 2023-11-25 12:55:31,391 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/.tmp/family2/4b620d3361964eca823d598034d2e2a5 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/4b620d3361964eca823d598034d2e2a5 2023-11-25 12:55:31,394 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b620d3361964eca823d598034d2e2a5 2023-11-25 12:55:31,395 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c902f29bb39df121448280b255efeb4d/family2 of c902f29bb39df121448280b255efeb4d into 4b620d3361964eca823d598034d2e2a5(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:55:31,396 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for c902f29bb39df121448280b255efeb4d: 2023-11-25 12:55:31,396 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:55:31,396 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): 28de3526844060bb212fbaedf7d89ec8/family1 is initiating major compaction (all files) 2023-11-25 12:55:31,396 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:55:31,396 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:55:31,396 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of 28de3526844060bb212fbaedf7d89ec8/family1 in ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:31,396 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/a5ff51642a704e7abfc3b2a934b4ec3a, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/73f26dce687f4b83a568d4d8871dee8b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/66d8fd9c8d064fb9bd0c9b53462e20e3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/3cef4fe24ccd40dcb7d29ec7105ddba0, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/42bd32c9e7e5450cb4062e5a1c9c0211] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp, totalSize=26.6 K 2023-11-25 12:55:31,396 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting a5ff51642a704e7abfc3b2a934b4ec3a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916920142 2023-11-25 12:55:31,397 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 73f26dce687f4b83a568d4d8871dee8b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916921556 2023-11-25 12:55:31,397 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 66d8fd9c8d064fb9bd0c9b53462e20e3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916922201 2023-11-25 12:55:31,397 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 3cef4fe24ccd40dcb7d29ec7105ddba0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916923610 2023-11-25 12:55:31,398 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 42bd32c9e7e5450cb4062e5a1c9c0211, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-25 12:55:31,407 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): 28de3526844060bb212fbaedf7d89ec8#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:55:31,414 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/eb93d9b432ee4fff892c907aac3e9925, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/9b1f006655bc49bcbf76c01db9447739, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/be082f085dec478abfc56672b01cce77, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/d4a7300ef2e346e989222a7034a719c0, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/e6c0e2920f464803a59fdcc2e2c00b52] to archive 2023-11-25 12:55:31,415 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:31,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/eb93d9b432ee4fff892c907aac3e9925 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/eb93d9b432ee4fff892c907aac3e9925 2023-11-25 12:55:31,417 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/9b1f006655bc49bcbf76c01db9447739 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/9b1f006655bc49bcbf76c01db9447739 2023-11-25 12:55:31,418 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/be082f085dec478abfc56672b01cce77 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/be082f085dec478abfc56672b01cce77 2023-11-25 12:55:31,419 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/d4a7300ef2e346e989222a7034a719c0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/d4a7300ef2e346e989222a7034a719c0 2023-11-25 12:55:31,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/e6c0e2920f464803a59fdcc2e2c00b52 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family2/e6c0e2920f464803a59fdcc2e2c00b52 2023-11-25 12:55:31,815 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231125962c7b25084545a2994c891d127e3e2d_del 2023-11-25 12:55:31,815 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125962c7b25084545a2994c891d127e3e2d_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231125962c7b25084545a2994c891d127e3e2d_del 2023-11-25 12:55:32,628 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8974a8a2894d474183d2ae2740e34eaa 2023-11-25 12:55:32,629 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family1/8974a8a2894d474183d2ae2740e34eaa as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/8974a8a2894d474183d2ae2740e34eaa 2023-11-25 12:55:32,632 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8974a8a2894d474183d2ae2740e34eaa 2023-11-25 12:55:32,633 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 28de3526844060bb212fbaedf7d89ec8/family1 of 28de3526844060bb212fbaedf7d89ec8 into 8974a8a2894d474183d2ae2740e34eaa(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:55:32,633 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for 28de3526844060bb212fbaedf7d89ec8: 2023-11-25 12:55:32,633 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:55:32,633 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): 28de3526844060bb212fbaedf7d89ec8/family2 is initiating major compaction (all files) 2023-11-25 12:55:32,633 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:55:32,633 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:55:32,635 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of 28de3526844060bb212fbaedf7d89ec8/family2 in ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:55:32,635 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/d5175edb4a5d405192d9af23e43b8601, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/3f8aa5b3a06147f585c48983995ea792, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/289e03cd0f2b4cd2b99fb0dd3bcb3987, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/ae4deabb99ae444e8993c7dde0fb38eb, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/8b3d1c39fff041bb86d1ab8c307190cb] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp, totalSize=25.3 K 2023-11-25 12:55:32,635 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting d5175edb4a5d405192d9af23e43b8601, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916920142 2023-11-25 12:55:32,635 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 3f8aa5b3a06147f585c48983995ea792, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916921556 2023-11-25 12:55:32,636 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 289e03cd0f2b4cd2b99fb0dd3bcb3987, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916922201 2023-11-25 12:55:32,636 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting ae4deabb99ae444e8993c7dde0fb38eb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916923610 2023-11-25 12:55:32,636 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 8b3d1c39fff041bb86d1ab8c307190cb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-25 12:55:32,644 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): 28de3526844060bb212fbaedf7d89ec8#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:55:32,713 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/a5ff51642a704e7abfc3b2a934b4ec3a, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/73f26dce687f4b83a568d4d8871dee8b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/66d8fd9c8d064fb9bd0c9b53462e20e3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/3cef4fe24ccd40dcb7d29ec7105ddba0, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/42bd32c9e7e5450cb4062e5a1c9c0211] to archive 2023-11-25 12:55:32,714 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:32,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/a5ff51642a704e7abfc3b2a934b4ec3a to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/a5ff51642a704e7abfc3b2a934b4ec3a 2023-11-25 12:55:32,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/73f26dce687f4b83a568d4d8871dee8b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/73f26dce687f4b83a568d4d8871dee8b 2023-11-25 12:55:32,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/66d8fd9c8d064fb9bd0c9b53462e20e3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/66d8fd9c8d064fb9bd0c9b53462e20e3 2023-11-25 12:55:32,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/3cef4fe24ccd40dcb7d29ec7105ddba0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/3cef4fe24ccd40dcb7d29ec7105ddba0 2023-11-25 12:55:32,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/42bd32c9e7e5450cb4062e5a1c9c0211 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/42bd32c9e7e5450cb4062e5a1c9c0211 2023-11-25 12:55:33,051 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311258fca14a899214d9f877144b403cd34b0_del 2023-11-25 12:55:33,051 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311258fca14a899214d9f877144b403cd34b0_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311258fca14a899214d9f877144b403cd34b0_del 2023-11-25 12:55:33,864 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c40af97c00904d59910dd1f0ca37d3cd 2023-11-25 12:55:33,865 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/.tmp/family2/c40af97c00904d59910dd1f0ca37d3cd as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/c40af97c00904d59910dd1f0ca37d3cd 2023-11-25 12:55:33,868 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c40af97c00904d59910dd1f0ca37d3cd 2023-11-25 12:55:33,869 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 28de3526844060bb212fbaedf7d89ec8/family2 of 28de3526844060bb212fbaedf7d89ec8 into c40af97c00904d59910dd1f0ca37d3cd(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:55:33,869 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for 28de3526844060bb212fbaedf7d89ec8: 2023-11-25 12:55:33,872 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:33,875 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:33,878 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:33,879 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:33,883 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-25 12:55:33,896 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-25 12:55:33,899 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231125962c7b25084545a2994c891d127e3e2d_del 2023-11-25 12:55:33,903 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023112538de1ef586194153b012ad9477480a8c_del 2023-11-25 12:55:33,909 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023112596c6efa714884125a6002a7138ca61e8_del 2023-11-25 12:55:33,909 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-25 12:55:33,910 DEBUG [Listener at localhost/45289] zookeeper.ReadOnlyZKClient(139): Connect 0x5c77ca77 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:55:33,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/d5175edb4a5d405192d9af23e43b8601, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/3f8aa5b3a06147f585c48983995ea792, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/289e03cd0f2b4cd2b99fb0dd3bcb3987, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/ae4deabb99ae444e8993c7dde0fb38eb, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/8b3d1c39fff041bb86d1ab8c307190cb] to archive 2023-11-25 12:55:33,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:33,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/d5175edb4a5d405192d9af23e43b8601 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/d5175edb4a5d405192d9af23e43b8601 2023-11-25 12:55:33,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/3f8aa5b3a06147f585c48983995ea792 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/3f8aa5b3a06147f585c48983995ea792 2023-11-25 12:55:33,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/289e03cd0f2b4cd2b99fb0dd3bcb3987 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/289e03cd0f2b4cd2b99fb0dd3bcb3987 2023-11-25 12:55:33,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/ae4deabb99ae444e8993c7dde0fb38eb to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/ae4deabb99ae444e8993c7dde0fb38eb 2023-11-25 12:55:33,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/8b3d1c39fff041bb86d1ab8c307190cb to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family2/8b3d1c39fff041bb86d1ab8c307190cb 2023-11-25 12:55:33,931 DEBUG [Listener at localhost/45289] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e9fcd06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:55:33,932 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231125 for table='ns:testMinorCompaction' and column='family1' 2023-11-25 12:55:33,932 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231125 for table='ns:testMinorCompaction' and column='family1' 2023-11-25 12:55:33,932 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231125 for table='ns:testMinorCompaction' and column='family1' 2023-11-25 12:55:34,363 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125292a7d51613e44f3a5b8be4b262f0ddf to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231125292a7d51613e44f3a5b8be4b262f0ddf 2023-11-25 12:55:34,363 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231125 table='ns:testMinorCompaction' column='family1' 2023-11-25 12:55:34,376 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:55:34,378 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:55:34,385 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:55:34,388 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:55:34,400 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231125/family1/3b1bba12e52f486b97a9a6543b517bb6 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-25 12:55:34,401 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231125/family1/3b1bba12e52f486b97a9a6543b517bb6}] 2023-11-25 12:55:34,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231125/family1/3b1bba12e52f486b97a9a6543b517bb6 for inclusion in 429309f3707a667a7044d0fa7d8d576d/family1 2023-11-25 12:55:34,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-25 12:55:34,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-25 12:55:34,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 429309f3707a667a7044d0fa7d8d576d: 2023-11-25 12:55:34,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231125/family1/3b1bba12e52f486b97a9a6543b517bb6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__ns_testMinorCompaction__cl586sebq3cpmoaq18sdk8m54jibh0spo9qdp0590kplmartupirdein88pvhe7e/family1/3b1bba12e52f486b97a9a6543b517bb6 2023-11-25 12:55:34,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__ns_testMinorCompaction__cl586sebq3cpmoaq18sdk8m54jibh0spo9qdp0590kplmartupirdein88pvhe7e/family1/3b1bba12e52f486b97a9a6543b517bb6 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/0bc1c92330f944a6957b29108db089d0_SeqId_28_ 2023-11-25 12:55:34,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__ns_testMinorCompaction__cl586sebq3cpmoaq18sdk8m54jibh0spo9qdp0590kplmartupirdein88pvhe7e/family1/3b1bba12e52f486b97a9a6543b517bb6 into 429309f3707a667a7044d0fa7d8d576d/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/0bc1c92330f944a6957b29108db089d0_SeqId_28_ - updating store file list. 2023-11-25 12:55:34,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/0bc1c92330f944a6957b29108db089d0_SeqId_28_ into 429309f3707a667a7044d0fa7d8d576d/family1 2023-11-25 12:55:34,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__ns_testMinorCompaction__cl586sebq3cpmoaq18sdk8m54jibh0spo9qdp0590kplmartupirdein88pvhe7e/family1/3b1bba12e52f486b97a9a6543b517bb6 into 429309f3707a667a7044d0fa7d8d576d/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/family1/0bc1c92330f944a6957b29108db089d0_SeqId_28_) 2023-11-25 12:55:34,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__ns_testMinorCompaction__cl586sebq3cpmoaq18sdk8m54jibh0spo9qdp0590kplmartupirdein88pvhe7e/family1/3b1bba12e52f486b97a9a6543b517bb6 2023-11-25 12:55:34,417 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231125 table='ns:testMinorCompaction' column='family1' 2023-11-25 12:55:34,418 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:34,419 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231125d59e952bdafd4760a8b7f1c61737904b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231125d59e952bdafd4760a8b7f1c61737904b 2023-11-25 12:55:34,419 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-25 12:55:34,419 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231125' 2023-11-25 12:55:34,419 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231125 for table='ns:testMinorCompaction' and column='family1' 2023-11-25 12:55:34,761 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112507153a8c3c6d4d9bb5154d51f0a6ca2e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112507153a8c3c6d4d9bb5154d51f0a6ca2e 2023-11-25 12:55:34,762 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231125 table='ns:testMinorCompaction' column='family1' 2023-11-25 12:55:34,762 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125220acff14a0e4637ba5fab467c0c661f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231125220acff14a0e4637ba5fab467c0c661f 2023-11-25 12:55:34,763 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231125 table='ns:testMinorCompaction' column='family1' 2023-11-25 12:55:34,786 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231125/family1/b7cf94aadc3e406b9871ca8677875153 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-25 12:55:34,786 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231125/family1/ce90f17ead354a558e7f1f7199ddde3f first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-25 12:55:34,787 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231125/family1/b7cf94aadc3e406b9871ca8677875153}] 2023-11-25 12:55:34,787 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231125/family1/ce90f17ead354a558e7f1f7199ddde3f}] 2023-11-25 12:55:34,789 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231125/family1/b7cf94aadc3e406b9871ca8677875153 for inclusion in 28de3526844060bb212fbaedf7d89ec8/family1 2023-11-25 12:55:34,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231125/family1/ce90f17ead354a558e7f1f7199ddde3f for inclusion in c902f29bb39df121448280b255efeb4d/family1 2023-11-25 12:55:34,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-25 12:55:34,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last=1 2023-11-25 12:55:34,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-25 12:55:34,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-25 12:55:34,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 28de3526844060bb212fbaedf7d89ec8: 2023-11-25 12:55:34,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for c902f29bb39df121448280b255efeb4d: 2023-11-25 12:55:34,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231125/family1/ce90f17ead354a558e7f1f7199ddde3f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__ns_testMinorCompaction__g5709vb6r2u53o3crf4aloqs56nhelh2oevbomv83bqeffd9nkvrhqst68qru8o/family1/ce90f17ead354a558e7f1f7199ddde3f 2023-11-25 12:55:34,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231125/family1/b7cf94aadc3e406b9871ca8677875153 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__ns_testMinorCompaction__abgpilec3achtvgfp97l8oujmsqnetj2nu972r2t305ti5vers0bb74n2hr4l543/family1/b7cf94aadc3e406b9871ca8677875153 2023-11-25 12:55:34,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__ns_testMinorCompaction__g5709vb6r2u53o3crf4aloqs56nhelh2oevbomv83bqeffd9nkvrhqst68qru8o/family1/ce90f17ead354a558e7f1f7199ddde3f as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/2449e72802c64204ab3f98012c00f9dd_SeqId_28_ 2023-11-25 12:55:34,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__ns_testMinorCompaction__abgpilec3achtvgfp97l8oujmsqnetj2nu972r2t305ti5vers0bb74n2hr4l543/family1/b7cf94aadc3e406b9871ca8677875153 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/dd47c198c39f47e58d77208be21fba02_SeqId_28_ 2023-11-25 12:55:34,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__ns_testMinorCompaction__g5709vb6r2u53o3crf4aloqs56nhelh2oevbomv83bqeffd9nkvrhqst68qru8o/family1/ce90f17ead354a558e7f1f7199ddde3f into c902f29bb39df121448280b255efeb4d/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/2449e72802c64204ab3f98012c00f9dd_SeqId_28_ - updating store file list. 2023-11-25 12:55:34,794 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__ns_testMinorCompaction__abgpilec3achtvgfp97l8oujmsqnetj2nu972r2t305ti5vers0bb74n2hr4l543/family1/b7cf94aadc3e406b9871ca8677875153 into 28de3526844060bb212fbaedf7d89ec8/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/dd47c198c39f47e58d77208be21fba02_SeqId_28_ - updating store file list. 2023-11-25 12:55:34,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/2449e72802c64204ab3f98012c00f9dd_SeqId_28_ into c902f29bb39df121448280b255efeb4d/family1 2023-11-25 12:55:34,797 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/dd47c198c39f47e58d77208be21fba02_SeqId_28_ into 28de3526844060bb212fbaedf7d89ec8/family1 2023-11-25 12:55:34,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__ns_testMinorCompaction__g5709vb6r2u53o3crf4aloqs56nhelh2oevbomv83bqeffd9nkvrhqst68qru8o/family1/ce90f17ead354a558e7f1f7199ddde3f into c902f29bb39df121448280b255efeb4d/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/family1/2449e72802c64204ab3f98012c00f9dd_SeqId_28_) 2023-11-25 12:55:34,797 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__ns_testMinorCompaction__abgpilec3achtvgfp97l8oujmsqnetj2nu972r2t305ti5vers0bb74n2hr4l543/family1/b7cf94aadc3e406b9871ca8677875153 into 28de3526844060bb212fbaedf7d89ec8/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/family1/dd47c198c39f47e58d77208be21fba02_SeqId_28_) 2023-11-25 12:55:34,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__ns_testMinorCompaction__g5709vb6r2u53o3crf4aloqs56nhelh2oevbomv83bqeffd9nkvrhqst68qru8o/family1/ce90f17ead354a558e7f1f7199ddde3f 2023-11-25 12:55:34,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__ns_testMinorCompaction__abgpilec3achtvgfp97l8oujmsqnetj2nu972r2t305ti5vers0bb74n2hr4l543/family1/b7cf94aadc3e406b9871ca8677875153 2023-11-25 12:55:34,799 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231125 table='ns:testMinorCompaction' column='family1' 2023-11-25 12:55:34,799 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231125 table='ns:testMinorCompaction' column='family1' 2023-11-25 12:55:34,799 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:34,799 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:34,800 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231125d714915cab5f46f5a39e819851dae93f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231125d714915cab5f46f5a39e819851dae93f 2023-11-25 12:55:34,801 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-25 12:55:34,801 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231125' 2023-11-25 12:55:34,801 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231125d0d3325f01a94edda4c73fd3ccb32d34 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231125d0d3325f01a94edda4c73fd3ccb32d34 2023-11-25 12:55:34,801 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-25 12:55:34,801 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231125' 2023-11-25 12:55:34,801 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231125 for table='ns:testMinorCompaction' and column='family1' 2023-11-25 12:55:34,801 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231125 for table='ns:testMinorCompaction' and column='family1' 2023-11-25 12:55:34,801 INFO [Listener at localhost/45289] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-25 12:55:34,803 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:34,805 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:34,807 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:34,807 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:34,824 INFO [Listener at localhost/45289] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=250 (was 287), OpenFileDescriptor=661 (was 783), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=165 (was 162) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=7943 (was 7992) 2023-11-25 12:55:34,835 INFO [Listener at localhost/45289] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=661, MaxFileDescriptor=60000, SystemLoadAverage=165, ProcessCount=170, AvailableMemoryMB=7942 2023-11-25 12:55:34,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-25 12:55:34,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:34,838 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-25 12:55:34,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-25 12:55:34,838 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-25 12:55:34,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-25 12:55:34,840 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35 2023-11-25 12:55:34,840 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35 empty. 2023-11-25 12:55:34,840 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35 2023-11-25 12:55:34,841 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-25 12:55:34,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-25 12:55:35,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-25 12:55:35,247 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-25 12:55:35,249 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => bddfe0320af31574f2d4a9b59b62fc35, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:55:35,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-25 12:55:35,654 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:35,654 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing bddfe0320af31574f2d4a9b59b62fc35, disabling compactions & flushes 2023-11-25 12:55:35,654 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:35,654 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:35,654 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. after waiting 0 ms 2023-11-25 12:55:35,654 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:35,654 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:35,654 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:35,656 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-25 12:55:35,657 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700916935657"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916935657"}]},"ts":"1700916935657"} 2023-11-25 12:55:35,659 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-25 12:55:35,659 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-25 12:55:35,659 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916935659"}]},"ts":"1700916935659"} 2023-11-25 12:55:35,660 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-25 12:55:35,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=bddfe0320af31574f2d4a9b59b62fc35, ASSIGN}] 2023-11-25 12:55:35,666 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=bddfe0320af31574f2d4a9b59b62fc35, ASSIGN 2023-11-25 12:55:35,666 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=bddfe0320af31574f2d4a9b59b62fc35, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:55:35,817 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=bddfe0320af31574f2d4a9b59b62fc35, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:35,818 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700916935817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916935817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916935817"}]},"ts":"1700916935817"} 2023-11-25 12:55:35,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure bddfe0320af31574f2d4a9b59b62fc35, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:55:35,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-25 12:55:35,970 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:35,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:35,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bddfe0320af31574f2d4a9b59b62fc35, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35.', STARTKEY => '', ENDKEY => ''} 2023-11-25 12:55:35,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy bddfe0320af31574f2d4a9b59b62fc35 2023-11-25 12:55:35,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:35,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bddfe0320af31574f2d4a9b59b62fc35 2023-11-25 12:55:35,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bddfe0320af31574f2d4a9b59b62fc35 2023-11-25 12:55:35,974 INFO [StoreOpener-bddfe0320af31574f2d4a9b59b62fc35-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bddfe0320af31574f2d4a9b59b62fc35 2023-11-25 12:55:35,975 DEBUG [StoreOpener-bddfe0320af31574f2d4a9b59b62fc35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1 2023-11-25 12:55:35,975 DEBUG [StoreOpener-bddfe0320af31574f2d4a9b59b62fc35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1 2023-11-25 12:55:35,976 INFO [StoreOpener-bddfe0320af31574f2d4a9b59b62fc35-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bddfe0320af31574f2d4a9b59b62fc35 columnFamilyName family1 2023-11-25 12:55:35,977 INFO [StoreOpener-bddfe0320af31574f2d4a9b59b62fc35-1] regionserver.HStore(310): Store=bddfe0320af31574f2d4a9b59b62fc35/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:35,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35 2023-11-25 12:55:35,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35 2023-11-25 12:55:35,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bddfe0320af31574f2d4a9b59b62fc35 2023-11-25 12:55:35,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:55:35,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bddfe0320af31574f2d4a9b59b62fc35; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69943325, jitterRate=0.04223676025867462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-25 12:55:35,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:35,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35., pid=114, masterSystemTime=1700916935970 2023-11-25 12:55:35,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:35,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:35,983 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=bddfe0320af31574f2d4a9b59b62fc35, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:35,984 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700916935983"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916935983"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916935983"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916935983"}]},"ts":"1700916935983"} 2023-11-25 12:55:35,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=114, resume processing ppid=113 2023-11-25 12:55:35,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure bddfe0320af31574f2d4a9b59b62fc35, server=jenkins-hbase4.apache.org,37051,1700916801082 in 166 msec 2023-11-25 12:55:35,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=113, resume processing ppid=112 2023-11-25 12:55:35,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=bddfe0320af31574f2d4a9b59b62fc35, ASSIGN in 321 msec 2023-11-25 12:55:35,987 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-25 12:55:35,987 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916935987"}]},"ts":"1700916935987"} 2023-11-25 12:55:35,988 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-25 12:55:35,990 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-25 12:55:35,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1540 sec 2023-11-25 12:55:36,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-25 12:55:36,943 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-25 12:55:36,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:36,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:36,960 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:36,960 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:36,960 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:55:36,960 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:55:36,960 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:36,961 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:36,962 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:36,962 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:36,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:36,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:36,962 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:36,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:36,962 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:36,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:36,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:36,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:36,963 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:36,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:36,963 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:55:36,963 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:36,963 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:55:36,965 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:55:36,965 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:36,966 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:36,966 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. started... 2023-11-25 12:55:36,966 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bddfe0320af31574f2d4a9b59b62fc35 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-25 12:55:37,386 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511300d250951e38544e490e2ef6aeb754302 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511300d250951e38544e490e2ef6aeb754302 2023-11-25 12:55:37,790 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/b1cd0646825745a2b9fbcf0c19a4b8af 2023-11-25 12:55:37,794 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/b1cd0646825745a2b9fbcf0c19a4b8af as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/b1cd0646825745a2b9fbcf0c19a4b8af 2023-11-25 12:55:37,796 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/b1cd0646825745a2b9fbcf0c19a4b8af, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-25 12:55:37,797 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for bddfe0320af31574f2d4a9b59b62fc35 in 831ms, sequenceid=5, compaction requested=false 2023-11-25 12:55:37,797 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:37,798 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:37,798 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:37,798 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:55:37,798 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:55:37,798 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,798 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:55:37,798 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:55:37,802 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,802 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:37,803 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,803 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:37,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:55:37,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29aedb8a[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:37,804 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:55:37,804 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,805 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,805 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:55:37,805 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:55:37,805 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:37,806 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,806 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:37,807 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,807 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:55:37,807 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,807 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:55:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:37,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:37,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:37,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:55:37,809 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:55:37,809 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:37,809 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:37,809 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,809 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:37,814 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,814 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,814 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:37,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:37,814 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,816 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:37,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,818 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,818 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,818 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,819 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,819 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,819 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,819 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:37,819 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:37,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:37,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:37,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:37,819 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:37,819 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:37,819 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:37,819 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:37,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:37,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:37,919 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:37,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:37,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:37,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:37,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,925 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:37,925 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:37,925 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:55:37,925 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:55:37,926 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,926 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,927 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,927 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:37,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:37,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:37,927 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:37,927 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:37,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:37,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,928 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,928 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:55:37,928 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:37,928 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:55:37,928 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:37,928 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:55:37,929 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:55:37,929 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:37,929 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:37,929 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. started... 2023-11-25 12:55:37,929 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bddfe0320af31574f2d4a9b59b62fc35 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-25 12:55:38,339 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128011021bd488d4edbbec49405d6fe7ec2 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128011021bd488d4edbbec49405d6fe7ec2 2023-11-25 12:55:38,744 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/7f24982636404a228bc98bb05c936fb0 2023-11-25 12:55:38,748 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/7f24982636404a228bc98bb05c936fb0 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/7f24982636404a228bc98bb05c936fb0 2023-11-25 12:55:38,751 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/7f24982636404a228bc98bb05c936fb0, entries=1, sequenceid=9, filesize=5.0 K 2023-11-25 12:55:38,752 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for bddfe0320af31574f2d4a9b59b62fc35 in 823ms, sequenceid=9, compaction requested=false 2023-11-25 12:55:38,752 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:38,752 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:38,752 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:55:38,752 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:55:38,752 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,752 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:55:38,752 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:55:38,753 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,753 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:38,754 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,754 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:38,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:55:38,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fbc741b[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:38,755 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:55:38,755 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,757 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,757 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:55:38,757 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:55:38,757 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:38,757 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,757 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:38,758 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:55:38,758 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,758 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:38,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:38,758 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:55:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:38,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:55:38,761 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:55:38,761 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:38,761 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:38,761 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,761 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:38,762 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,762 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,762 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:38,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:38,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:38,763 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:38,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,764 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:38,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,766 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,766 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,766 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:38,766 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,766 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:38,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:38,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:38,766 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:38,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:38,766 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:38,766 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,766 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,766 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,766 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:38,766 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:38,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:38,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:38,866 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:38,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:38,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:38,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:38,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,872 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:38,872 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:38,872 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:55:38,872 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:55:38,873 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,873 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,875 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:38,875 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:38,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:38,875 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:38,875 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:38,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:38,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,876 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,876 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:55:38,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:38,876 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:55:38,876 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:38,876 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:55:38,877 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:55:38,877 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:38,877 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:38,877 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. started... 2023-11-25 12:55:38,877 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bddfe0320af31574f2d4a9b59b62fc35 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:55:39,292 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120117fdecc6bb6c45c3a10ab6b0a1bcc79a to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120117fdecc6bb6c45c3a10ab6b0a1bcc79a 2023-11-25 12:55:39,697 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/25ebc5604d394d06a092fcb85537c288 2023-11-25 12:55:39,701 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/25ebc5604d394d06a092fcb85537c288 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/25ebc5604d394d06a092fcb85537c288 2023-11-25 12:55:39,704 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/25ebc5604d394d06a092fcb85537c288, entries=1, sequenceid=13, filesize=4.9 K 2023-11-25 12:55:39,705 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bddfe0320af31574f2d4a9b59b62fc35 in 828ms, sequenceid=13, compaction requested=true 2023-11-25 12:55:39,705 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:39,705 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:39,705 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:55:39,705 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:55:39,705 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,705 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:55:39,705 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:55:39,706 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,706 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:39,707 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,707 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:39,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:39,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:39,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:39,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:55:39,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e6ffb6c[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:39,708 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:55:39,708 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,709 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,709 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:55:39,709 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:55:39,709 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:39,709 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,709 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:39,710 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:55:39,710 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,710 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:39,710 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:55:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:39,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:39,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:55:39,713 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:55:39,713 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:39,713 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:39,713 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,713 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:39,715 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,715 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:39,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:39,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,715 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:39,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:39,716 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:39,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:39,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:39,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,717 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:39,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,721 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,721 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,721 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:39,721 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,721 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:39,721 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:39,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:39,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:39,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:39,721 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:39,722 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,722 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,722 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,722 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:39,722 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:39,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:39,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:39,822 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:39,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:39,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:39,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:39,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,827 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:39,828 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:39,828 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:55:39,828 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:55:39,828 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,828 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,829 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,829 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:39,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:39,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:39,829 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:39,829 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:39,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:39,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,830 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,830 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:55:39,830 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:55:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:55:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:55:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:39,831 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:39,831 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. started... 2023-11-25 12:55:39,831 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bddfe0320af31574f2d4a9b59b62fc35 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:55:40,241 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ccba71de8d4b424c912a57541965964a to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205ccba71de8d4b424c912a57541965964a 2023-11-25 12:55:40,646 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/ce6fe3b11a8b48e084e56b037031d1fd 2023-11-25 12:55:40,650 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/ce6fe3b11a8b48e084e56b037031d1fd as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/ce6fe3b11a8b48e084e56b037031d1fd 2023-11-25 12:55:40,653 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/ce6fe3b11a8b48e084e56b037031d1fd, entries=1, sequenceid=17, filesize=4.9 K 2023-11-25 12:55:40,654 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bddfe0320af31574f2d4a9b59b62fc35 in 823ms, sequenceid=17, compaction requested=true 2023-11-25 12:55:40,654 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:40,654 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:40,654 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:55:40,654 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:55:40,654 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,654 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:55:40,654 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:55:40,657 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,657 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:40,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:40,658 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,658 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:40,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:55:40,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7aecbe63[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:40,659 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:55:40,659 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,660 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,660 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:55:40,660 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:55:40,660 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:40,660 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,660 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:40,661 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:55:40,661 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:40,661 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,661 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:55:40,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:40,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:40,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:40,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:40,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:40,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:40,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:55:40,664 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:55:40,664 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:40,664 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:40,664 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,664 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:40,665 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,665 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:40,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:40,665 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:40,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:40,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:40,666 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:40,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:40,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,667 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:40,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,674 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,674 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,674 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,674 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:40,674 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:40,674 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-25 12:55:40,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:40,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:40,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:40,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:40,674 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:40,674 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,674 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,675 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,675 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:40,675 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:40,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:40,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:40,775 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:40,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:40,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:40,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:40,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,781 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:40,781 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:40,781 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:55:40,781 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:55:40,781 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,781 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,782 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:40,782 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:40,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:40,783 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:40,783 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:40,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,783 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:40,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,783 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,783 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:55:40,783 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:40,783 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:55:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:55:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:55:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:40,784 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:40,784 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. started... 2023-11-25 12:55:40,784 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bddfe0320af31574f2d4a9b59b62fc35 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:55:41,194 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228d2760cf42cf44c0e90685755cccd759f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228d2760cf42cf44c0e90685755cccd759f 2023-11-25 12:55:41,515 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-25 12:55:41,598 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/7728de37212a4920b886caf255f8d617 2023-11-25 12:55:41,605 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/7728de37212a4920b886caf255f8d617 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/7728de37212a4920b886caf255f8d617 2023-11-25 12:55:41,609 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/7728de37212a4920b886caf255f8d617, entries=1, sequenceid=21, filesize=4.9 K 2023-11-25 12:55:41,610 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bddfe0320af31574f2d4a9b59b62fc35 in 826ms, sequenceid=21, compaction requested=true 2023-11-25 12:55:41,610 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:41,610 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:41,610 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:55:41,610 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:55:41,610 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,610 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:55:41,610 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:55:41,612 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,613 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,613 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,613 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:41,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:41,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:41,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:41,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:41,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:41,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:55:41,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25c1583f[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:41,615 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:55:41,615 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,616 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,617 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:55:41,617 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:55:41,617 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:41,617 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,617 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:41,618 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,618 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:55:41,618 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:41,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:41,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:41,618 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:55:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:41,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:41,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:41,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:55:41,622 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:55:41,622 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:41,622 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:41,622 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,622 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:41,624 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,624 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:41,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,625 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:41,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,626 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:41,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,627 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,631 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,631 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,631 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,631 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,631 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,631 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,631 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,631 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:41,631 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:41,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:41,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:41,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:41,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:41,631 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:41,632 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:41,632 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:41,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:41,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:41,732 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:41,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:41,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:41,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:41,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,739 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:41,739 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:41,739 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:55:41,739 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:55:41,739 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,739 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,741 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:41,741 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:41,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:41,741 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:41,741 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:41,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:41,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,742 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,742 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:55:41,742 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:41,742 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:55:41,742 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:41,742 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:55:41,743 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:55:41,743 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:41,743 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:41,743 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. started... 2023-11-25 12:55:41,743 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bddfe0320af31574f2d4a9b59b62fc35 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:55:42,154 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313d6c9e63d44e425286948e46de087458 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512313d6c9e63d44e425286948e46de087458 2023-11-25 12:55:42,161 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/e9eda30fd4a84ae4909a7bc2516c6137 2023-11-25 12:55:42,165 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/e9eda30fd4a84ae4909a7bc2516c6137 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/e9eda30fd4a84ae4909a7bc2516c6137 2023-11-25 12:55:42,168 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/e9eda30fd4a84ae4909a7bc2516c6137, entries=1, sequenceid=25, filesize=4.9 K 2023-11-25 12:55:42,169 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bddfe0320af31574f2d4a9b59b62fc35 in 426ms, sequenceid=25, compaction requested=true 2023-11-25 12:55:42,169 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:42,169 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:42,169 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:55:42,169 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:55:42,169 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,169 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:55:42,169 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:55:42,172 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,172 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:42,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:42,172 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,172 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:42,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:42,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:42,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:42,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:55:42,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4931fc30[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:42,174 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:55:42,174 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,175 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,175 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:55:42,175 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:55:42,175 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:42,175 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,175 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:42,180 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,180 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:55:42,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:42,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:42,180 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:42,180 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:55:42,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:42,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:42,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:42,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:42,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:55:42,182 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:55:42,182 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:42,182 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:42,182 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,182 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:42,185 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:42,185 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:42,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,185 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:42,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:42,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:42,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,186 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:42,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:42,188 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,190 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,190 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,190 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:42,190 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:42,190 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:42,190 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,190 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,190 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,190 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:42,191 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:42,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:42,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:42,191 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:42,192 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:42,292 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:42,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:42,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:42,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:42,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,298 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:42,298 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:42,298 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:55:42,298 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:55:42,298 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,298 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,300 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,300 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:42,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:42,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:42,300 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:42,300 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:42,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:42,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,301 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,301 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:55:42,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:42,302 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:55:42,302 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:42,302 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:55:42,302 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:55:42,302 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:42,302 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:42,302 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. started... 2023-11-25 12:55:42,302 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bddfe0320af31574f2d4a9b59b62fc35 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:55:42,722 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010175f1318c43cf41f386dc9bd8b2e4ecd4 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010175f1318c43cf41f386dc9bd8b2e4ecd4 2023-11-25 12:55:43,127 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/d4636d2fd62b4d77a4badfc276389ce9 2023-11-25 12:55:43,130 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/d4636d2fd62b4d77a4badfc276389ce9 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/d4636d2fd62b4d77a4badfc276389ce9 2023-11-25 12:55:43,133 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/d4636d2fd62b4d77a4badfc276389ce9, entries=1, sequenceid=29, filesize=4.9 K 2023-11-25 12:55:43,134 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bddfe0320af31574f2d4a9b59b62fc35 in 832ms, sequenceid=29, compaction requested=true 2023-11-25 12:55:43,134 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:43,134 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:43,134 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:55:43,134 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:55:43,134 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,134 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:55:43,134 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:55:43,136 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,136 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:43,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:43,136 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,136 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:43,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:43,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:43,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:43,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:55:43,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4884dae1[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:43,138 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:55:43,138 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,140 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,140 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:55:43,140 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:55:43,140 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,141 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:43,140 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:43,142 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:55:43,142 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:43,142 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,142 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:55:43,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:43,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:43,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:43,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:43,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:43,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:43,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:55:43,144 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:55:43,144 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:43,144 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:43,144 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,144 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:43,145 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,145 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:43,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:43,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,146 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:43,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:43,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:43,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:43,146 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:43,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,147 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:43,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,149 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,150 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:43,150 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,150 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:43,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:43,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:43,150 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:43,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:43,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:43,150 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,150 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,150 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:43,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:43,150 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:43,150 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:43,150 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,150 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,250 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:43,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:43,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:43,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:43,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,257 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:43,257 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:43,257 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:55:43,257 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:55:43,257 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,257 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,259 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,259 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:43,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:43,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:43,260 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:43,260 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:43,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:43,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,261 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,261 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:55:43,261 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:43,261 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:55:43,261 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:43,261 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:55:43,261 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:55:43,261 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:43,261 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:43,261 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. started... 2023-11-25 12:55:43,261 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bddfe0320af31574f2d4a9b59b62fc35 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:55:43,672 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103564f5be418e94918b3af226b43b63a06 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103564f5be418e94918b3af226b43b63a06 2023-11-25 12:55:44,077 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/3583031e9c974f3ea36642eb405f3868 2023-11-25 12:55:44,081 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/3583031e9c974f3ea36642eb405f3868 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3583031e9c974f3ea36642eb405f3868 2023-11-25 12:55:44,085 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3583031e9c974f3ea36642eb405f3868, entries=1, sequenceid=33, filesize=4.9 K 2023-11-25 12:55:44,086 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bddfe0320af31574f2d4a9b59b62fc35 in 825ms, sequenceid=33, compaction requested=true 2023-11-25 12:55:44,086 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:44,086 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:44,086 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:55:44,086 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:55:44,086 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,087 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:55:44,087 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:55:44,088 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,088 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:44,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:44,089 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:44,089 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:44,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:44,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:44,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:55:44,090 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:55:44,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57046a34[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:44,090 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,093 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,093 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:55:44,093 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:55:44,093 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:44,093 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,093 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:44,094 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,094 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:55:44,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:55:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:44,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:44,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:44,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:55:44,097 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:55:44,097 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:44,097 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:44,098 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,098 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:44,099 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,099 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:44,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:44,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,099 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:44,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:44,100 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:44,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:44,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:44,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,101 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:44,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,103 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:44,103 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,103 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:44,103 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:44,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:44,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:44,103 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,103 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:44,104 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:44,104 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,104 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,104 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,104 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:44,104 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:44,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:44,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:44,204 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:44,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:44,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:44,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:44,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,212 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:44,212 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:44,212 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:55:44,212 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:55:44,213 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,213 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,217 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:44,217 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:44,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:44,218 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:44,218 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:44,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:44,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,219 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,223 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:55:44,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:44,223 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:55:44,223 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:44,223 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:55:44,224 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:55:44,224 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:44,224 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:44,224 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. started... 2023-11-25 12:55:44,224 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bddfe0320af31574f2d4a9b59b62fc35 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:55:44,643 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ef08708ceab944b2a4f70ba7235ef256 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907ef08708ceab944b2a4f70ba7235ef256 2023-11-25 12:55:45,049 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/3701c725748d44a8b6c79c87d16c10ae 2023-11-25 12:55:45,054 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/3701c725748d44a8b6c79c87d16c10ae as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3701c725748d44a8b6c79c87d16c10ae 2023-11-25 12:55:45,057 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3701c725748d44a8b6c79c87d16c10ae, entries=1, sequenceid=37, filesize=4.9 K 2023-11-25 12:55:45,058 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bddfe0320af31574f2d4a9b59b62fc35 in 834ms, sequenceid=37, compaction requested=true 2023-11-25 12:55:45,058 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:45,058 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:45,058 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:55:45,058 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:55:45,058 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,058 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:55:45,058 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:55:45,062 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,062 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:45,063 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,063 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:45,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:55:45,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78abd04b[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:45,065 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:55:45,065 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,066 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:55:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:55:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:45,066 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,067 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:45,068 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,068 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:55:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:45,068 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:45,068 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:55:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:45,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:45,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:45,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:55:45,071 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:55:45,071 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:45,071 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:45,071 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,071 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:45,074 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,074 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,074 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:45,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,077 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,078 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,080 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:45,080 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:45,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:45,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:45,080 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:45,080 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:45,081 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:45,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:45,080 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:45,081 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:45,081 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,081 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,081 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,081 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,081 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,181 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:45,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:45,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:45,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:45,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,187 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:45,187 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:45,187 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-25 12:55:45,187 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-25 12:55:45,187 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,187 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,188 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,189 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:45,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:45,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:45,189 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:45,189 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:45,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:45,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,190 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,190 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-25 12:55:45,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:45,190 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-25 12:55:45,190 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:45,190 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-25 12:55:45,190 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-25 12:55:45,190 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:45,190 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:45,190 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. started... 2023-11-25 12:55:45,190 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bddfe0320af31574f2d4a9b59b62fc35 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-25 12:55:45,607 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112073b9634f25c54e87be8e68a3c57b775e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112073b9634f25c54e87be8e68a3c57b775e 2023-11-25 12:55:46,011 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/24737b569413482fbc89861ec17958a2 2023-11-25 12:55:46,015 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/24737b569413482fbc89861ec17958a2 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/24737b569413482fbc89861ec17958a2 2023-11-25 12:55:46,018 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/24737b569413482fbc89861ec17958a2, entries=1, sequenceid=41, filesize=4.9 K 2023-11-25 12:55:46,019 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bddfe0320af31574f2d4a9b59b62fc35 in 829ms, sequenceid=41, compaction requested=true 2023-11-25 12:55:46,019 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:46,019 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:46,019 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-25 12:55:46,019 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-25 12:55:46,019 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:46,019 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-25 12:55:46,019 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-25 12:55:46,021 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:46,021 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:46,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:46,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:46,021 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,021 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:46,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:46,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:46,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:46,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:46,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-25 12:55:46,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ebd7312[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:46,022 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-25 12:55:46,022 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,025 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,025 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-25 12:55:46,025 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-25 12:55:46,025 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:46,025 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:46,025 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:46,026 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:46,026 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-25 12:55:46,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:46,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:46,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:46,026 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:46,026 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-25 12:55:46,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:46,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:46,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:46,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:46,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:46,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:46,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-25 12:55:46,029 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-25 12:55:46,029 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:46,029 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:46,029 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,029 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:46,030 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,030 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:46,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:46,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,030 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:46,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:46,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:46,031 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:46,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,032 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:46,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:46,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:46,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:46,034 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:46,034 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,034 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,034 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:46,034 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,034 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,034 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:46,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-25 12:55:46,034 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:46,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-25 12:55:46,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:46,034 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:46,034 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:46,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:46,035 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:46,035 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:46,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:46,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:46,135 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:46,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:46,137 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38201] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-25 12:55:46,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-25 12:55:46,139 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-25 12:55:46,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:55:46,140 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700917546140 2023-11-25 12:55:46,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-25 12:55:46,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-25 12:55:46,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:55:46,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] zookeeper.ReadOnlyZKClient(139): Connect 0x183f5df4 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:55:46,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e05624d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:55:46,152 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:55:46,587 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010380bb95a61a3a4744a5071fb90d4b61cf to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010380bb95a61a3a4744a5071fb90d4b61cf 2023-11-25 12:55:46,588 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:55:46,601 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:55:46,603 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:55:46,608 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:55:46,609 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:55:46,616 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/bf632fab5d8a425d8b505a622d731c8f first=Optional[r5] last=Optional[r6] 2023-11-25 12:55:46,617 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/bf632fab5d8a425d8b505a622d731c8f}] 2023-11-25 12:55:46,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/bf632fab5d8a425d8b505a622d731c8f for inclusion in bddfe0320af31574f2d4a9b59b62fc35/family1 2023-11-25 12:55:46,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-25 12:55:46,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:55:46,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:46,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/bf632fab5d8a425d8b505a622d731c8f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__nm4fnqig8ntub86cqenbrk6s4d83i2sar03gbs1p8mbv4ge2sl8e66raedkqn527/family1/bf632fab5d8a425d8b505a622d731c8f 2023-11-25 12:55:46,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__nm4fnqig8ntub86cqenbrk6s4d83i2sar03gbs1p8mbv4ge2sl8e66raedkqn527/family1/bf632fab5d8a425d8b505a622d731c8f as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/612314b68aff4a71b0cc51a3c32da1bb_SeqId_44_ 2023-11-25 12:55:46,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__nm4fnqig8ntub86cqenbrk6s4d83i2sar03gbs1p8mbv4ge2sl8e66raedkqn527/family1/bf632fab5d8a425d8b505a622d731c8f into bddfe0320af31574f2d4a9b59b62fc35/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/612314b68aff4a71b0cc51a3c32da1bb_SeqId_44_ - updating store file list. 2023-11-25 12:55:46,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/612314b68aff4a71b0cc51a3c32da1bb_SeqId_44_ into bddfe0320af31574f2d4a9b59b62fc35/family1 2023-11-25 12:55:46,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__nm4fnqig8ntub86cqenbrk6s4d83i2sar03gbs1p8mbv4ge2sl8e66raedkqn527/family1/bf632fab5d8a425d8b505a622d731c8f into bddfe0320af31574f2d4a9b59b62fc35/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/612314b68aff4a71b0cc51a3c32da1bb_SeqId_44_) 2023-11-25 12:55:46,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__nm4fnqig8ntub86cqenbrk6s4d83i2sar03gbs1p8mbv4ge2sl8e66raedkqn527/family1/bf632fab5d8a425d8b505a622d731c8f 2023-11-25 12:55:46,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-25 12:55:46,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-25 12:55:46,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(1912): bddfe0320af31574f2d4a9b59b62fc35/family1 is initiating minor compaction 2023-11-25 12:55:46,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7901512b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:55:46,632 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of bddfe0320af31574f2d4a9b59b62fc35/family1 in testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:46,632 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/7f24982636404a228bc98bb05c936fb0, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/25ebc5604d394d06a092fcb85537c288, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/ce6fe3b11a8b48e084e56b037031d1fd, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/7728de37212a4920b886caf255f8d617, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/e9eda30fd4a84ae4909a7bc2516c6137, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/d4636d2fd62b4d77a4badfc276389ce9, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3583031e9c974f3ea36642eb405f3868, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3701c725748d44a8b6c79c87d16c10ae, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/24737b569413482fbc89861ec17958a2, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/612314b68aff4a71b0cc51a3c32da1bb_SeqId_44_] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp, totalSize=49.7 K 2023-11-25 12:55:46,632 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 7f24982636404a228bc98bb05c936fb0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-25 12:55:46,633 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 25ebc5604d394d06a092fcb85537c288, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-25 12:55:46,633 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting ce6fe3b11a8b48e084e56b037031d1fd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-25 12:55:46,633 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 7728de37212a4920b886caf255f8d617, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-25 12:55:46,633 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting e9eda30fd4a84ae4909a7bc2516c6137, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-25 12:55:46,633 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting d4636d2fd62b4d77a4badfc276389ce9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-25 12:55:46,633 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 3583031e9c974f3ea36642eb405f3868, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-25 12:55:46,633 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 3701c725748d44a8b6c79c87d16c10ae, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-25 12:55:46,633 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 24737b569413482fbc89861ec17958a2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-25 12:55:46,633 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 612314b68aff4a71b0cc51a3c32da1bb_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-25 12:55:46,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:55:46,635 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:46,637 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010175f1318c43cf41f386dc9bd8b2e4ecd4 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010175f1318c43cf41f386dc9bd8b2e4ecd4 2023-11-25 12:55:46,638 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103564f5be418e94918b3af226b43b63a06 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103564f5be418e94918b3af226b43b63a06 2023-11-25 12:55:46,638 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-25 12:55:46,638 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-25 12:55:46,639 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:55:46,639 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:55:46,669 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): bddfe0320af31574f2d4a9b59b62fc35#family1#compaction#164 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-25 12:55:47,093 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123159e8120777e04963b77462f6cf453b3e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123159e8120777e04963b77462f6cf453b3e 2023-11-25 12:55:47,094 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:55:47,116 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/25008fb9956549a6ac3a222c4bcded08 first=Optional[r1] last=Optional[r4] 2023-11-25 12:55:47,117 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/25008fb9956549a6ac3a222c4bcded08}] 2023-11-25 12:55:47,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/25008fb9956549a6ac3a222c4bcded08 for inclusion in bddfe0320af31574f2d4a9b59b62fc35/family1 2023-11-25 12:55:47,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-25 12:55:47,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:55:47,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:47,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/25008fb9956549a6ac3a222c4bcded08 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2damkbm4t5jhn2vv2ul28b3o7vm2b60ei52lq0n5kvimuhv0vggbgpstoe5h93po/family1/25008fb9956549a6ac3a222c4bcded08 2023-11-25 12:55:47,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2damkbm4t5jhn2vv2ul28b3o7vm2b60ei52lq0n5kvimuhv0vggbgpstoe5h93po/family1/25008fb9956549a6ac3a222c4bcded08 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/2d5adea1d60947f7b958cbc8f8afdce2_SeqId_46_ 2023-11-25 12:55:47,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2damkbm4t5jhn2vv2ul28b3o7vm2b60ei52lq0n5kvimuhv0vggbgpstoe5h93po/family1/25008fb9956549a6ac3a222c4bcded08 into bddfe0320af31574f2d4a9b59b62fc35/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/2d5adea1d60947f7b958cbc8f8afdce2_SeqId_46_ - updating store file list. 2023-11-25 12:55:47,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/2d5adea1d60947f7b958cbc8f8afdce2_SeqId_46_ into bddfe0320af31574f2d4a9b59b62fc35/family1 2023-11-25 12:55:47,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2damkbm4t5jhn2vv2ul28b3o7vm2b60ei52lq0n5kvimuhv0vggbgpstoe5h93po/family1/25008fb9956549a6ac3a222c4bcded08 into bddfe0320af31574f2d4a9b59b62fc35/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/2d5adea1d60947f7b958cbc8f8afdce2_SeqId_46_) 2023-11-25 12:55:47,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2damkbm4t5jhn2vv2ul28b3o7vm2b60ei52lq0n5kvimuhv0vggbgpstoe5h93po/family1/25008fb9956549a6ac3a222c4bcded08 2023-11-25 12:55:47,129 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:55:47,129 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:47,130 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120117fdecc6bb6c45c3a10ab6b0a1bcc79a to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120117fdecc6bb6c45c3a10ab6b0a1bcc79a 2023-11-25 12:55:47,132 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205ccba71de8d4b424c912a57541965964a to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205ccba71de8d4b424c912a57541965964a 2023-11-25 12:55:47,133 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228d2760cf42cf44c0e90685755cccd759f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228d2760cf42cf44c0e90685755cccd759f 2023-11-25 12:55:47,134 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512313d6c9e63d44e425286948e46de087458 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512313d6c9e63d44e425286948e46de087458 2023-11-25 12:55:47,134 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-25 12:55:47,134 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-25 12:55:47,134 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:55:47,134 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:55:47,492 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/3e79de33d9ab40e99a97960ff1156d24 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3e79de33d9ab40e99a97960ff1156d24 2023-11-25 12:55:47,496 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in bddfe0320af31574f2d4a9b59b62fc35/family1 of bddfe0320af31574f2d4a9b59b62fc35 into 3e79de33d9ab40e99a97960ff1156d24(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:55:47,496 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:47,496 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700916946632; duration=0sec 2023-11-25 12:55:47,496 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:55:47,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/7f24982636404a228bc98bb05c936fb0, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/25ebc5604d394d06a092fcb85537c288, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/ce6fe3b11a8b48e084e56b037031d1fd, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/7728de37212a4920b886caf255f8d617, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/e9eda30fd4a84ae4909a7bc2516c6137, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/d4636d2fd62b4d77a4badfc276389ce9, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3583031e9c974f3ea36642eb405f3868, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3701c725748d44a8b6c79c87d16c10ae, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/24737b569413482fbc89861ec17958a2, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/612314b68aff4a71b0cc51a3c32da1bb_SeqId_44_] to archive 2023-11-25 12:55:47,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:47,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/7f24982636404a228bc98bb05c936fb0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/7f24982636404a228bc98bb05c936fb0 2023-11-25 12:55:47,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/25ebc5604d394d06a092fcb85537c288 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/25ebc5604d394d06a092fcb85537c288 2023-11-25 12:55:47,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/ce6fe3b11a8b48e084e56b037031d1fd to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/ce6fe3b11a8b48e084e56b037031d1fd 2023-11-25 12:55:47,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/7728de37212a4920b886caf255f8d617 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/7728de37212a4920b886caf255f8d617 2023-11-25 12:55:47,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/e9eda30fd4a84ae4909a7bc2516c6137 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/e9eda30fd4a84ae4909a7bc2516c6137 2023-11-25 12:55:47,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/d4636d2fd62b4d77a4badfc276389ce9 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/d4636d2fd62b4d77a4badfc276389ce9 2023-11-25 12:55:47,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3583031e9c974f3ea36642eb405f3868 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3583031e9c974f3ea36642eb405f3868 2023-11-25 12:55:47,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3701c725748d44a8b6c79c87d16c10ae to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3701c725748d44a8b6c79c87d16c10ae 2023-11-25 12:55:47,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/24737b569413482fbc89861ec17958a2 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/24737b569413482fbc89861ec17958a2 2023-11-25 12:55:47,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/612314b68aff4a71b0cc51a3c32da1bb_SeqId_44_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/612314b68aff4a71b0cc51a3c32da1bb_SeqId_44_ 2023-11-25 12:55:47,982 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307e79ed43322d402b9b6fb46542ba36a9 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511307e79ed43322d402b9b6fb46542ba36a9 2023-11-25 12:55:47,984 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:55:48,013 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0d123bd0de444687a01acfa9abb0dce4 first=Optional[r00] last=Optional[r8] 2023-11-25 12:55:48,022 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0d123bd0de444687a01acfa9abb0dce4}] 2023-11-25 12:55:48,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0d123bd0de444687a01acfa9abb0dce4 for inclusion in bddfe0320af31574f2d4a9b59b62fc35/family1 2023-11-25 12:55:48,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-25 12:55:48,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last= 2023-11-25 12:55:48,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:48,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0d123bd0de444687a01acfa9abb0dce4 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5n7nsqnjp1knopg4tqt723n4bmi9dlr9ca16h7lrnt4rprroe330kggcehjuah7t/family1/0d123bd0de444687a01acfa9abb0dce4 2023-11-25 12:55:48,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5n7nsqnjp1knopg4tqt723n4bmi9dlr9ca16h7lrnt4rprroe330kggcehjuah7t/family1/0d123bd0de444687a01acfa9abb0dce4 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/632b97e6ac4c47e98d17435fe782e1da_SeqId_49_ 2023-11-25 12:55:48,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5n7nsqnjp1knopg4tqt723n4bmi9dlr9ca16h7lrnt4rprroe330kggcehjuah7t/family1/0d123bd0de444687a01acfa9abb0dce4 into bddfe0320af31574f2d4a9b59b62fc35/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/632b97e6ac4c47e98d17435fe782e1da_SeqId_49_ - updating store file list. 2023-11-25 12:55:48,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/632b97e6ac4c47e98d17435fe782e1da_SeqId_49_ into bddfe0320af31574f2d4a9b59b62fc35/family1 2023-11-25 12:55:48,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5n7nsqnjp1knopg4tqt723n4bmi9dlr9ca16h7lrnt4rprroe330kggcehjuah7t/family1/0d123bd0de444687a01acfa9abb0dce4 into bddfe0320af31574f2d4a9b59b62fc35/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/632b97e6ac4c47e98d17435fe782e1da_SeqId_49_) 2023-11-25 12:55:48,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5n7nsqnjp1knopg4tqt723n4bmi9dlr9ca16h7lrnt4rprroe330kggcehjuah7t/family1/0d123bd0de444687a01acfa9abb0dce4 2023-11-25 12:55:48,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-25 12:55:48,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-25 12:55:48,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(1912): bddfe0320af31574f2d4a9b59b62fc35/family1 is initiating minor compaction (all files) 2023-11-25 12:55:48,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@66e0cad1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:55:48,039 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of bddfe0320af31574f2d4a9b59b62fc35/family1 in testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:55:48,039 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/b1cd0646825745a2b9fbcf0c19a4b8af, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3e79de33d9ab40e99a97960ff1156d24, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/2d5adea1d60947f7b958cbc8f8afdce2_SeqId_46_, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/632b97e6ac4c47e98d17435fe782e1da_SeqId_49_] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp, totalSize=344.3 K 2023-11-25 12:55:48,039 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting b1cd0646825745a2b9fbcf0c19a4b8af, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878825182 2023-11-25 12:55:48,040 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 3e79de33d9ab40e99a97960ff1156d24, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621225182 2023-11-25 12:55:48,040 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 2d5adea1d60947f7b958cbc8f8afdce2_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965225182 2023-11-25 12:55:48,041 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] compactions.Compactor(207): Compacting 632b97e6ac4c47e98d17435fe782e1da_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014825182 2023-11-25 12:55:48,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:55:48,042 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:48,044 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112073b9634f25c54e87be8e68a3c57b775e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112073b9634f25c54e87be8e68a3c57b775e 2023-11-25 12:55:48,045 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128011021bd488d4edbbec49405d6fe7ec2 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128011021bd488d4edbbec49405d6fe7ec2 2023-11-25 12:55:48,048 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511300d250951e38544e490e2ef6aeb754302 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511300d250951e38544e490e2ef6aeb754302 2023-11-25 12:55:48,048 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-25 12:55:48,048 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-25 12:55:48,050 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:55:48,050 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:55:48,050 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-25 12:55:48,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-25 12:55:48,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:55:48,058 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-25 12:55:48,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.9200 sec 2023-11-25 12:55:48,069 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] throttle.PressureAwareThroughputController(145): bddfe0320af31574f2d4a9b59b62fc35#family1#compaction#165 average throughput is 15.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-25 12:55:48,354 INFO [Listener at localhost/45289] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=257 (was 250) - Thread LEAK? -, OpenFileDescriptor=678 (was 661) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=182 (was 165) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=7989 (was 7942) - AvailableMemoryMB LEAK? - 2023-11-25 12:55:48,369 INFO [Listener at localhost/45289] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=257, OpenFileDescriptor=678, MaxFileDescriptor=60000, SystemLoadAverage=182, ProcessCount=170, AvailableMemoryMB=7987 2023-11-25 12:55:48,390 DEBUG [Listener at localhost/45289] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-25 12:55:48,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x1A\xA6\xC9D\xCF\xB3LPI,Dd\xB0\x12\x8F\x12"\x10\xA0V/\xD9\x9C\x8D)\xAC_\x08\xA1t\xA4F\x8Ax*\x10\xBB\x0F\x9E|\x01qu\xC7-\x1C\x14\x1D\xA4\xF39\x132\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-25 12:55:48,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-25 12:55:48,445 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-25 12:55:48,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-25 12:55:48,445 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-25 12:55:48,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-25 12:55:48,447 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429 2023-11-25 12:55:48,447 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d 2023-11-25 12:55:48,447 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac 2023-11-25 12:55:48,447 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429 empty. 2023-11-25 12:55:48,447 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d empty. 2023-11-25 12:55:48,448 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac empty. 2023-11-25 12:55:48,448 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429 2023-11-25 12:55:48,448 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d 2023-11-25 12:55:48,448 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac 2023-11-25 12:55:48,448 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-25 12:55:48,502 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/.tmp/family1/4c51967dcf5f434094fa05f86081207a as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/4c51967dcf5f434094fa05f86081207a 2023-11-25 12:55:48,506 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in bddfe0320af31574f2d4a9b59b62fc35/family1 of bddfe0320af31574f2d4a9b59b62fc35 into 4c51967dcf5f434094fa05f86081207a(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:55:48,506 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:55:48,506 INFO [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1700916948038; duration=0sec 2023-11-25 12:55:48,506 DEBUG [RS:0;jenkins-hbase4:37051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-25 12:55:48,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/b1cd0646825745a2b9fbcf0c19a4b8af, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3e79de33d9ab40e99a97960ff1156d24, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/2d5adea1d60947f7b958cbc8f8afdce2_SeqId_46_, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/632b97e6ac4c47e98d17435fe782e1da_SeqId_49_] to archive 2023-11-25 12:55:48,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:55:48,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/b1cd0646825745a2b9fbcf0c19a4b8af to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/b1cd0646825745a2b9fbcf0c19a4b8af 2023-11-25 12:55:48,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3e79de33d9ab40e99a97960ff1156d24 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/3e79de33d9ab40e99a97960ff1156d24 2023-11-25 12:55:48,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/2d5adea1d60947f7b958cbc8f8afdce2_SeqId_46_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/2d5adea1d60947f7b958cbc8f8afdce2_SeqId_46_ 2023-11-25 12:55:48,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/632b97e6ac4c47e98d17435fe782e1da_SeqId_49_ to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/family1/632b97e6ac4c47e98d17435fe782e1da_SeqId_49_ 2023-11-25 12:55:48,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-25 12:55:48,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-25 12:55:48,854 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-25 12:55:48,856 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => e9128328793d2459a3b3db7860adadac, NAME => 'testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x1A\xA6\xC9D\xCF\xB3LPI,Dd\xB0\x12\x8F\x12"\x10\xA0V/\xD9\x9C\x8D)\xAC_\x08\xA1t\xA4F\x8Ax*\x10\xBB\x0F\x9E|\x01qu\xC7-\x1C\x14\x1D\xA4\xF39\x132\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:55:48,856 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 26762a13b8f4e0904821d5326eb08429, NAME => 'testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x1A\xA6\xC9D\xCF\xB3LPI,Dd\xB0\x12\x8F\x12"\x10\xA0V/\xD9\x9C\x8D)\xAC_\x08\xA1t\xA4F\x8Ax*\x10\xBB\x0F\x9E|\x01qu\xC7-\x1C\x14\x1D\xA4\xF39\x132\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:55:48,856 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5f338262d368d869dcf38f98b5e0eb5d, NAME => 'testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x1A\xA6\xC9D\xCF\xB3LPI,Dd\xB0\x12\x8F\x12"\x10\xA0V/\xD9\x9C\x8D)\xAC_\x08\xA1t\xA4F\x8Ax*\x10\xBB\x0F\x9E|\x01qu\xC7-\x1C\x14\x1D\xA4\xF39\x132\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/.tmp 2023-11-25 12:55:48,873 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:48,873 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 26762a13b8f4e0904821d5326eb08429, disabling compactions & flushes 2023-11-25 12:55:48,873 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:48,873 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:48,873 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. after waiting 0 ms 2023-11-25 12:55:48,873 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:48,873 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:48,873 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 26762a13b8f4e0904821d5326eb08429: 2023-11-25 12:55:49,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-25 12:55:49,273 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:49,273 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing e9128328793d2459a3b3db7860adadac, disabling compactions & flushes 2023-11-25 12:55:49,273 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:49,273 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:49,273 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. after waiting 0 ms 2023-11-25 12:55:49,273 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:49,273 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:49,273 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for e9128328793d2459a3b3db7860adadac: 2023-11-25 12:55:49,274 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:49,274 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 5f338262d368d869dcf38f98b5e0eb5d, disabling compactions & flushes 2023-11-25 12:55:49,274 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:49,274 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:49,274 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. after waiting 0 ms 2023-11-25 12:55:49,274 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:49,274 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:49,274 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 5f338262d368d869dcf38f98b5e0eb5d: 2023-11-25 12:55:49,276 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-25 12:55:49,277 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700916949277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916949277"}]},"ts":"1700916949277"} 2023-11-25 12:55:49,277 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700916949277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916949277"}]},"ts":"1700916949277"} 2023-11-25 12:55:49,277 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700916949277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700916949277"}]},"ts":"1700916949277"} 2023-11-25 12:55:49,278 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-25 12:55:49,279 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-25 12:55:49,279 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916949279"}]},"ts":"1700916949279"} 2023-11-25 12:55:49,280 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-25 12:55:49,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=26762a13b8f4e0904821d5326eb08429, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5f338262d368d869dcf38f98b5e0eb5d, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e9128328793d2459a3b3db7860adadac, ASSIGN}] 2023-11-25 12:55:49,284 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e9128328793d2459a3b3db7860adadac, ASSIGN 2023-11-25 12:55:49,284 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5f338262d368d869dcf38f98b5e0eb5d, ASSIGN 2023-11-25 12:55:49,284 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=26762a13b8f4e0904821d5326eb08429, ASSIGN 2023-11-25 12:55:49,285 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5f338262d368d869dcf38f98b5e0eb5d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:55:49,285 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=26762a13b8f4e0904821d5326eb08429, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:55:49,285 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e9128328793d2459a3b3db7860adadac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37051,1700916801082; forceNewPlan=false, retain=false 2023-11-25 12:55:49,436 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=5f338262d368d869dcf38f98b5e0eb5d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:49,436 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=e9128328793d2459a3b3db7860adadac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:49,437 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700916949436"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916949436"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916949436"}]},"ts":"1700916949436"} 2023-11-25 12:55:49,436 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=26762a13b8f4e0904821d5326eb08429, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:49,437 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700916949436"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916949436"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916949436"}]},"ts":"1700916949436"} 2023-11-25 12:55:49,437 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700916949436"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700916949436"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700916949436"}]},"ts":"1700916949436"} 2023-11-25 12:55:49,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure 5f338262d368d869dcf38f98b5e0eb5d, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:55:49,439 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure e9128328793d2459a3b3db7860adadac, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:55:49,439 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure 26762a13b8f4e0904821d5326eb08429, server=jenkins-hbase4.apache.org,37051,1700916801082}] 2023-11-25 12:55:49,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-25 12:55:49,589 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:49,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:49,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e9128328793d2459a3b3db7860adadac, NAME => 'testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac.', STARTKEY => '2', ENDKEY => ''} 2023-11-25 12:55:49,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin e9128328793d2459a3b3db7860adadac 2023-11-25 12:55:49,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:49,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e9128328793d2459a3b3db7860adadac 2023-11-25 12:55:49,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e9128328793d2459a3b3db7860adadac 2023-11-25 12:55:49,618 INFO [StoreOpener-e9128328793d2459a3b3db7860adadac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e9128328793d2459a3b3db7860adadac 2023-11-25 12:55:49,620 DEBUG [StoreOpener-e9128328793d2459a3b3db7860adadac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1 2023-11-25 12:55:49,620 DEBUG [StoreOpener-e9128328793d2459a3b3db7860adadac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1 2023-11-25 12:55:49,620 INFO [StoreOpener-e9128328793d2459a3b3db7860adadac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9128328793d2459a3b3db7860adadac columnFamilyName family1 2023-11-25 12:55:49,622 INFO [StoreOpener-e9128328793d2459a3b3db7860adadac-1] regionserver.HStore(310): Store=e9128328793d2459a3b3db7860adadac/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:49,622 INFO [StoreOpener-e9128328793d2459a3b3db7860adadac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e9128328793d2459a3b3db7860adadac 2023-11-25 12:55:49,623 DEBUG [StoreOpener-e9128328793d2459a3b3db7860adadac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2 2023-11-25 12:55:49,623 DEBUG [StoreOpener-e9128328793d2459a3b3db7860adadac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2 2023-11-25 12:55:49,624 INFO [StoreOpener-e9128328793d2459a3b3db7860adadac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9128328793d2459a3b3db7860adadac columnFamilyName family2 2023-11-25 12:55:49,625 INFO [StoreOpener-e9128328793d2459a3b3db7860adadac-1] regionserver.HStore(310): Store=e9128328793d2459a3b3db7860adadac/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:49,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac 2023-11-25 12:55:49,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac 2023-11-25 12:55:49,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-25 12:55:49,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e9128328793d2459a3b3db7860adadac 2023-11-25 12:55:49,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:55:49,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e9128328793d2459a3b3db7860adadac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65551794, jitterRate=-0.02320215106010437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-25 12:55:49,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e9128328793d2459a3b3db7860adadac: 2023-11-25 12:55:49,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac., pid=121, masterSystemTime=1700916949589 2023-11-25 12:55:49,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:49,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:49,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:49,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 26762a13b8f4e0904821d5326eb08429, NAME => 'testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429.', STARTKEY => '', ENDKEY => '1'} 2023-11-25 12:55:49,632 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=e9128328793d2459a3b3db7860adadac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:49,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 26762a13b8f4e0904821d5326eb08429 2023-11-25 12:55:49,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:49,632 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700916949632"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916949632"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916949632"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916949632"}]},"ts":"1700916949632"} 2023-11-25 12:55:49,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 26762a13b8f4e0904821d5326eb08429 2023-11-25 12:55:49,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 26762a13b8f4e0904821d5326eb08429 2023-11-25 12:55:49,636 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=121, resume processing ppid=119 2023-11-25 12:55:49,636 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure e9128328793d2459a3b3db7860adadac, server=jenkins-hbase4.apache.org,37051,1700916801082 in 195 msec 2023-11-25 12:55:49,637 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e9128328793d2459a3b3db7860adadac, ASSIGN in 354 msec 2023-11-25 12:55:49,654 INFO [StoreOpener-26762a13b8f4e0904821d5326eb08429-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 26762a13b8f4e0904821d5326eb08429 2023-11-25 12:55:49,656 DEBUG [StoreOpener-26762a13b8f4e0904821d5326eb08429-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1 2023-11-25 12:55:49,656 DEBUG [StoreOpener-26762a13b8f4e0904821d5326eb08429-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1 2023-11-25 12:55:49,656 INFO [StoreOpener-26762a13b8f4e0904821d5326eb08429-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26762a13b8f4e0904821d5326eb08429 columnFamilyName family1 2023-11-25 12:55:49,657 INFO [StoreOpener-26762a13b8f4e0904821d5326eb08429-1] regionserver.HStore(310): Store=26762a13b8f4e0904821d5326eb08429/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:49,657 INFO [StoreOpener-26762a13b8f4e0904821d5326eb08429-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 26762a13b8f4e0904821d5326eb08429 2023-11-25 12:55:49,658 DEBUG [StoreOpener-26762a13b8f4e0904821d5326eb08429-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2 2023-11-25 12:55:49,659 DEBUG [StoreOpener-26762a13b8f4e0904821d5326eb08429-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2 2023-11-25 12:55:49,659 INFO [StoreOpener-26762a13b8f4e0904821d5326eb08429-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26762a13b8f4e0904821d5326eb08429 columnFamilyName family2 2023-11-25 12:55:49,660 INFO [StoreOpener-26762a13b8f4e0904821d5326eb08429-1] regionserver.HStore(310): Store=26762a13b8f4e0904821d5326eb08429/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:49,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429 2023-11-25 12:55:49,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429 2023-11-25 12:55:49,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-25 12:55:49,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 26762a13b8f4e0904821d5326eb08429 2023-11-25 12:55:49,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:55:49,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 26762a13b8f4e0904821d5326eb08429; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74295118, jitterRate=0.1070835292339325}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-25 12:55:49,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 26762a13b8f4e0904821d5326eb08429: 2023-11-25 12:55:49,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429., pid=122, masterSystemTime=1700916949589 2023-11-25 12:55:49,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:49,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:49,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:49,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f338262d368d869dcf38f98b5e0eb5d, NAME => 'testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d.', STARTKEY => '1', ENDKEY => '2'} 2023-11-25 12:55:49,667 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=26762a13b8f4e0904821d5326eb08429, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:49,667 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700916949667"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916949667"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916949667"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916949667"}]},"ts":"1700916949667"} 2023-11-25 12:55:49,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 5f338262d368d869dcf38f98b5e0eb5d 2023-11-25 12:55:49,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-25 12:55:49,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f338262d368d869dcf38f98b5e0eb5d 2023-11-25 12:55:49,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f338262d368d869dcf38f98b5e0eb5d 2023-11-25 12:55:49,670 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=122, resume processing ppid=117 2023-11-25 12:55:49,670 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure 26762a13b8f4e0904821d5326eb08429, server=jenkins-hbase4.apache.org,37051,1700916801082 in 229 msec 2023-11-25 12:55:49,671 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=26762a13b8f4e0904821d5326eb08429, ASSIGN in 388 msec 2023-11-25 12:55:49,694 INFO [StoreOpener-5f338262d368d869dcf38f98b5e0eb5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5f338262d368d869dcf38f98b5e0eb5d 2023-11-25 12:55:49,695 DEBUG [StoreOpener-5f338262d368d869dcf38f98b5e0eb5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1 2023-11-25 12:55:49,695 DEBUG [StoreOpener-5f338262d368d869dcf38f98b5e0eb5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1 2023-11-25 12:55:49,695 INFO [StoreOpener-5f338262d368d869dcf38f98b5e0eb5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f338262d368d869dcf38f98b5e0eb5d columnFamilyName family1 2023-11-25 12:55:49,696 INFO [StoreOpener-5f338262d368d869dcf38f98b5e0eb5d-1] regionserver.HStore(310): Store=5f338262d368d869dcf38f98b5e0eb5d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:49,697 INFO [StoreOpener-5f338262d368d869dcf38f98b5e0eb5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5f338262d368d869dcf38f98b5e0eb5d 2023-11-25 12:55:49,698 DEBUG [StoreOpener-5f338262d368d869dcf38f98b5e0eb5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2 2023-11-25 12:55:49,698 DEBUG [StoreOpener-5f338262d368d869dcf38f98b5e0eb5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2 2023-11-25 12:55:49,698 INFO [StoreOpener-5f338262d368d869dcf38f98b5e0eb5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f338262d368d869dcf38f98b5e0eb5d columnFamilyName family2 2023-11-25 12:55:49,699 INFO [StoreOpener-5f338262d368d869dcf38f98b5e0eb5d-1] regionserver.HStore(310): Store=5f338262d368d869dcf38f98b5e0eb5d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-25 12:55:49,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d 2023-11-25 12:55:49,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d 2023-11-25 12:55:49,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-25 12:55:49,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f338262d368d869dcf38f98b5e0eb5d 2023-11-25 12:55:49,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-25 12:55:49,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f338262d368d869dcf38f98b5e0eb5d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69633268, jitterRate=0.0376165509223938}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-25 12:55:49,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f338262d368d869dcf38f98b5e0eb5d: 2023-11-25 12:55:49,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d., pid=120, masterSystemTime=1700916949589 2023-11-25 12:55:49,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:49,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:49,708 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=5f338262d368d869dcf38f98b5e0eb5d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:49,708 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700916949708"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700916949708"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700916949708"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700916949708"}]},"ts":"1700916949708"} 2023-11-25 12:55:49,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=120, resume processing ppid=118 2023-11-25 12:55:49,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure 5f338262d368d869dcf38f98b5e0eb5d, server=jenkins-hbase4.apache.org,37051,1700916801082 in 271 msec 2023-11-25 12:55:49,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=118, resume processing ppid=116 2023-11-25 12:55:49,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5f338262d368d869dcf38f98b5e0eb5d, ASSIGN in 428 msec 2023-11-25 12:55:49,712 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-25 12:55:49,712 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700916949712"}]},"ts":"1700916949712"} 2023-11-25 12:55:49,713 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-25 12:55:49,715 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-25 12:55:49,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2720 sec 2023-11-25 12:55:50,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-25 12:55:50,550 INFO [Listener at localhost/45289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-25 12:55:50,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:50,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:50,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:50,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:50,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-25 12:55:50,560 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-25 12:55:50,561 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:50,561 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-25 12:55:50,561 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-25 12:55:50,561 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:50,561 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:50,564 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:50,564 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:50,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:50,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:50,564 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:50,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:50,564 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:50,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:50,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:50,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:50,565 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-25 12:55:50,565 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-25 12:55:50,565 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-25 12:55:50,565 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:50,565 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-25 12:55:50,565 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:50,565 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:50,565 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. started... 2023-11-25 12:55:50,566 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. started... 2023-11-25 12:55:50,566 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:55:50,567 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 5f338262d368d869dcf38f98b5e0eb5d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-25 12:55:50,567 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:50,567 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:50,567 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e9128328793d2459a3b3db7860adadac 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-25 12:55:50,567 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. started... 2023-11-25 12:55:50,568 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 26762a13b8f4e0904821d5326eb08429 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-25 12:55:51,012 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311255d082c77bf9a48ecafa520c07d8db8d8 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311255d082c77bf9a48ecafa520c07d8db8d8 2023-11-25 12:55:51,017 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125b2c2aa1be419458db983c99acfd85e79 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231125b2c2aa1be419458db983c99acfd85e79 2023-11-25 12:55:51,025 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125465fd239b8664afd83612cf21e98f7d7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231125465fd239b8664afd83612cf21e98f7d7 2023-11-25 12:55:51,039 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family1/d789d9617e3441718e62f4e04548661a 2023-11-25 12:55:51,040 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family1/be931a340d3244b49864b0f2c3ec4db0 2023-11-25 12:55:51,070 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311259bde52e87b304c8a95824dedfcca0fa1 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311259bde52e87b304c8a95824dedfcca0fa1 2023-11-25 12:55:51,078 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family2/429cfa50e25e4f939e96140b245a25fe 2023-11-25 12:55:51,082 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family1/d789d9617e3441718e62f4e04548661a as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/d789d9617e3441718e62f4e04548661a 2023-11-25 12:55:51,083 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125eb5396befbbb41d79e6480155d44dcd7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231125eb5396befbbb41d79e6480155d44dcd7 2023-11-25 12:55:51,107 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/d789d9617e3441718e62f4e04548661a, entries=4, sequenceid=5, filesize=5.5 K 2023-11-25 12:55:51,107 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family2/429cfa50e25e4f939e96140b245a25fe as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/429cfa50e25e4f939e96140b245a25fe 2023-11-25 12:55:51,110 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/429cfa50e25e4f939e96140b245a25fe, entries=2, sequenceid=5, filesize=5.1 K 2023-11-25 12:55:51,111 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5f338262d368d869dcf38f98b5e0eb5d in 545ms, sequenceid=5, compaction requested=false 2023-11-25 12:55:51,111 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-25 12:55:51,111 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 5f338262d368d869dcf38f98b5e0eb5d: 2023-11-25 12:55:51,112 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:51,112 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:55:51,434 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family1/e99c90bb01194e2486424e0b7855f4de 2023-11-25 12:55:51,469 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311257f82baa7c2514c238729c4a29be8e6b3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311257f82baa7c2514c238729c4a29be8e6b3 2023-11-25 12:55:51,492 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family2/4120949d6a1c48a9b9b143712c576305 2023-11-25 12:55:51,496 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family1/be931a340d3244b49864b0f2c3ec4db0 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/be931a340d3244b49864b0f2c3ec4db0 2023-11-25 12:55:51,523 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/be931a340d3244b49864b0f2c3ec4db0, entries=4, sequenceid=5, filesize=5.5 K 2023-11-25 12:55:51,524 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family2/4120949d6a1c48a9b9b143712c576305 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/4120949d6a1c48a9b9b143712c576305 2023-11-25 12:55:51,528 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/4120949d6a1c48a9b9b143712c576305, entries=2, sequenceid=5, filesize=5.1 K 2023-11-25 12:55:51,529 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e9128328793d2459a3b3db7860adadac in 963ms, sequenceid=5, compaction requested=false 2023-11-25 12:55:51,531 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e9128328793d2459a3b3db7860adadac: 2023-11-25 12:55:51,531 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:51,531 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:55:51,876 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family2/2fc8a4ca7fa54004bac3a92469fb41f4 2023-11-25 12:55:51,880 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family1/e99c90bb01194e2486424e0b7855f4de as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/e99c90bb01194e2486424e0b7855f4de 2023-11-25 12:55:51,906 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/e99c90bb01194e2486424e0b7855f4de, entries=4, sequenceid=5, filesize=5.5 K 2023-11-25 12:55:51,907 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family2/2fc8a4ca7fa54004bac3a92469fb41f4 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/2fc8a4ca7fa54004bac3a92469fb41f4 2023-11-25 12:55:51,911 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/2fc8a4ca7fa54004bac3a92469fb41f4, entries=2, sequenceid=5, filesize=5.1 K 2023-11-25 12:55:51,911 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 26762a13b8f4e0904821d5326eb08429 in 1343ms, sequenceid=5, compaction requested=false 2023-11-25 12:55:51,911 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 26762a13b8f4e0904821d5326eb08429: 2023-11-25 12:55:51,911 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:51,912 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:55:51,912 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:55:51,912 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:51,912 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-25 12:55:51,912 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-25 12:55:51,917 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:51,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:51,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:51,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:51,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:51,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:51,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:51,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:51,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:51,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-25 12:55:51,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5080e5f6[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:51,919 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-25 12:55:51,919 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:51,920 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:51,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:51,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:51,921 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-25 12:55:51,921 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-25 12:55:51,921 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:51,921 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:51,921 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:51,922 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-25 12:55:51,922 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:51,922 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:51,922 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-25 12:55:51,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:51,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:51,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:51,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:51,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:51,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:51,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:51,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:51,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:51,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:51,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:51,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-25 12:55:51,925 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-25 12:55:51,925 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:51,925 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:51,925 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-25 12:55:51,925 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:51,935 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:51,935 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:51,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:51,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:51,935 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:51,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:51,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:51,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:51,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:51,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:51,936 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:51,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:51,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:51,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:51,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:51,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:51,937 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:51,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:51,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:51,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:51,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:51,939 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:51,939 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:51,939 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:51,939 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:51,939 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:51,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-25 12:55:51,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:51,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:51,939 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:51,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-25 12:55:51,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:51,939 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:51,939 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:51,939 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:51,939 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:51,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:51,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:51,940 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:51,940 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:52,040 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:52,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:52,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:52,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:52,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:52,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:52,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:52,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-25 12:55:52,047 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-25 12:55:52,047 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:52,047 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-25 12:55:52,047 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-25 12:55:52,047 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:52,047 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:52,049 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:52,049 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:52,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:52,049 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:52,049 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:52,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:52,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:52,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:52,050 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-25 12:55:52,050 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-25 12:55:52,050 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-25 12:55:52,050 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-25 12:55:52,050 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:52,050 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-25 12:55:52,051 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:52,051 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. started... 2023-11-25 12:55:52,051 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:52,051 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:55:52,051 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:52,051 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e9128328793d2459a3b3db7860adadac 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-25 12:55:52,051 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. started... 2023-11-25 12:55:52,051 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:52,051 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. started... 2023-11-25 12:55:52,051 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 5f338262d368d869dcf38f98b5e0eb5d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-25 12:55:52,051 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 26762a13b8f4e0904821d5326eb08429 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-25 12:55:52,509 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112546e67d2468a74bcdb4a7ee2b9c8bb368 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023112546e67d2468a74bcdb4a7ee2b9c8bb368 2023-11-25 12:55:52,510 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311250edd7ed5a5fc442bb1551e28ff0ffd2f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311250edd7ed5a5fc442bb1551e28ff0ffd2f 2023-11-25 12:55:52,511 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311250b67574c60a14fe48827bceb4f736b6b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311250b67574c60a14fe48827bceb4f736b6b 2023-11-25 12:55:52,927 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family1/ea4b9a15770b4c64b3feaa3cf93bf4b5 2023-11-25 12:55:52,930 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family1/d85d2a0c5f924ce9bc67a94185f5f1e6 2023-11-25 12:55:52,932 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family1/11bef89d5b9f4d2590bee0b9d9715825 2023-11-25 12:55:52,984 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125dc7406eb62464a069c8235b4c00e3c3c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231125dc7406eb62464a069c8235b4c00e3c3c 2023-11-25 12:55:52,988 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family2/7be4c940009140e2acb6f1396f910ffb 2023-11-25 12:55:52,992 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family1/ea4b9a15770b4c64b3feaa3cf93bf4b5 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/ea4b9a15770b4c64b3feaa3cf93bf4b5 2023-11-25 12:55:53,016 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/ea4b9a15770b4c64b3feaa3cf93bf4b5, entries=4, sequenceid=9, filesize=5.5 K 2023-11-25 12:55:53,017 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family2/7be4c940009140e2acb6f1396f910ffb as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/7be4c940009140e2acb6f1396f910ffb 2023-11-25 12:55:53,022 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/7be4c940009140e2acb6f1396f910ffb, entries=2, sequenceid=9, filesize=5.1 K 2023-11-25 12:55:53,023 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5f338262d368d869dcf38f98b5e0eb5d in 972ms, sequenceid=9, compaction requested=false 2023-11-25 12:55:53,023 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 5f338262d368d869dcf38f98b5e0eb5d: 2023-11-25 12:55:53,023 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:53,023 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:55:53,373 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125734e93eded754ecd8968c913ac839b8d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231125734e93eded754ecd8968c913ac839b8d 2023-11-25 12:55:53,378 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family2/81df0b1be3164f87921f2bec959e8d06 2023-11-25 12:55:53,378 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231125cd63d335025a40b7803c2f9b0263a996 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231125cd63d335025a40b7803c2f9b0263a996 2023-11-25 12:55:53,381 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family1/d85d2a0c5f924ce9bc67a94185f5f1e6 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/d85d2a0c5f924ce9bc67a94185f5f1e6 2023-11-25 12:55:53,404 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/d85d2a0c5f924ce9bc67a94185f5f1e6, entries=4, sequenceid=9, filesize=5.5 K 2023-11-25 12:55:53,405 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family2/81df0b1be3164f87921f2bec959e8d06 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/81df0b1be3164f87921f2bec959e8d06 2023-11-25 12:55:53,408 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/81df0b1be3164f87921f2bec959e8d06, entries=2, sequenceid=9, filesize=5.1 K 2023-11-25 12:55:53,408 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e9128328793d2459a3b3db7860adadac in 1357ms, sequenceid=9, compaction requested=false 2023-11-25 12:55:53,409 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e9128328793d2459a3b3db7860adadac: 2023-11-25 12:55:53,409 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:53,409 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:55:53,783 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family2/c4184b1f910b4f0bb3f9f6bb455dbb2b 2023-11-25 12:55:53,786 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family1/11bef89d5b9f4d2590bee0b9d9715825 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/11bef89d5b9f4d2590bee0b9d9715825 2023-11-25 12:55:53,808 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/11bef89d5b9f4d2590bee0b9d9715825, entries=4, sequenceid=9, filesize=5.5 K 2023-11-25 12:55:53,809 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family2/c4184b1f910b4f0bb3f9f6bb455dbb2b as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/c4184b1f910b4f0bb3f9f6bb455dbb2b 2023-11-25 12:55:53,812 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/c4184b1f910b4f0bb3f9f6bb455dbb2b, entries=2, sequenceid=9, filesize=5.1 K 2023-11-25 12:55:53,812 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 26762a13b8f4e0904821d5326eb08429 in 1761ms, sequenceid=9, compaction requested=false 2023-11-25 12:55:53,812 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 26762a13b8f4e0904821d5326eb08429: 2023-11-25 12:55:53,812 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:53,812 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:55:53,813 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:55:53,813 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,813 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-25 12:55:53,813 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-25 12:55:53,814 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:53,814 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:53,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:53,814 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:53,815 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:53,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:53,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:53,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:53,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:53,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-25 12:55:53,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24216018[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:53,816 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-25 12:55:53,816 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:53,818 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:53,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:53,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:53,818 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-25 12:55:53,818 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-25 12:55:53,818 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:53,818 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,818 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:53,819 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-25 12:55:53,819 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:53,819 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,819 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-25 12:55:53,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:53,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:53,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:53,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:53,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:53,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:53,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:53,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:53,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-25 12:55:53,822 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-25 12:55:53,822 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:53,822 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:53,822 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-25 12:55:53,822 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:53,823 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:53,823 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:53,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:53,823 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:53,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:53,824 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,825 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:53,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,827 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,827 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:53,827 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:53,827 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:53,827 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:53,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:53,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-25 12:55:53,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:53,827 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:53,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:53,827 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,827 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:53,827 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:53,827 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:53,827 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:53,827 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:53,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:53,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:53,927 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:53,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:53,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:53,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:53,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:53,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:53,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:53,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-25 12:55:53,933 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-25 12:55:53,933 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:53,933 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-25 12:55:53,933 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-25 12:55:53,934 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:53,934 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:53,936 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:53,936 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:53,936 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:53,936 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:53,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:53,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:53,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:53,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:53,937 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-25 12:55:53,937 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-25 12:55:53,937 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-25 12:55:53,937 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-25 12:55:53,937 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:53,937 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-25 12:55:53,938 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:53,938 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. started... 2023-11-25 12:55:53,938 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:53,938 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. started... 2023-11-25 12:55:53,938 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:55:53,938 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 5f338262d368d869dcf38f98b5e0eb5d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-25 12:55:53,938 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:53,938 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. started... 2023-11-25 12:55:53,938 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e9128328793d2459a3b3db7860adadac 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-25 12:55:53,938 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:53,938 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 26762a13b8f4e0904821d5326eb08429 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-25 12:55:53,984 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112578ca2dc976af4fb5aabc3c9c223ef91e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112578ca2dc976af4fb5aabc3c9c223ef91e 2023-11-25 12:55:53,984 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125a977ebcaa03c432fbac030f0a9d3b0c0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231125a977ebcaa03c432fbac030f0a9d3b0c0 2023-11-25 12:55:53,984 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125a6bacde304704bcdaa40829f1401440e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231125a6bacde304704bcdaa40829f1401440e 2023-11-25 12:55:53,998 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family1/b850689a2f394f4a854724bacea8188a 2023-11-25 12:55:54,398 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family1/289035911ca7468f95369a53c03455ac 2023-11-25 12:55:54,399 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family1/e1e28f5854ab4018925cc876cf892bc2 2023-11-25 12:55:54,431 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311254592ce06d791452380144c7b0a2e1043 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311254592ce06d791452380144c7b0a2e1043 2023-11-25 12:55:54,435 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family2/eded7e12344d4e8c814eb6d2235bbee3 2023-11-25 12:55:54,438 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family1/b850689a2f394f4a854724bacea8188a as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/b850689a2f394f4a854724bacea8188a 2023-11-25 12:55:54,461 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/b850689a2f394f4a854724bacea8188a, entries=4, sequenceid=13, filesize=5.5 K 2023-11-25 12:55:54,461 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family2/eded7e12344d4e8c814eb6d2235bbee3 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/eded7e12344d4e8c814eb6d2235bbee3 2023-11-25 12:55:54,464 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/eded7e12344d4e8c814eb6d2235bbee3, entries=2, sequenceid=13, filesize=5.1 K 2023-11-25 12:55:54,465 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 26762a13b8f4e0904821d5326eb08429 in 527ms, sequenceid=13, compaction requested=true 2023-11-25 12:55:54,465 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 26762a13b8f4e0904821d5326eb08429: 2023-11-25 12:55:54,465 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:54,465 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:55:54,632 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:55:54,632 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x183f5df4 to 127.0.0.1:63200 2023-11-25 12:55:54,632 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:55:54,632 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:55:54,632 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c77ca77 to 127.0.0.1:63200 2023-11-25 12:55:54,632 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:55:54,832 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112553668c2de9454ac3a1a24cf6f329797b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023112553668c2de9454ac3a1a24cf6f329797b 2023-11-25 12:55:54,832 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112559df07e07e244990a743f3432714092d to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023112559df07e07e244990a743f3432714092d 2023-11-25 12:55:55,160 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-25 12:55:55,238 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family2/91594c4d7dbf4334ba7136b5526096e0 2023-11-25 12:55:55,238 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family2/aac94a443ed44c05820764c51911f949 2023-11-25 12:55:55,242 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family1/e1e28f5854ab4018925cc876cf892bc2 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/e1e28f5854ab4018925cc876cf892bc2 2023-11-25 12:55:55,243 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family1/289035911ca7468f95369a53c03455ac as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/289035911ca7468f95369a53c03455ac 2023-11-25 12:55:55,270 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/289035911ca7468f95369a53c03455ac, entries=4, sequenceid=13, filesize=5.5 K 2023-11-25 12:55:55,272 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family2/aac94a443ed44c05820764c51911f949 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/aac94a443ed44c05820764c51911f949 2023-11-25 12:55:55,272 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/e1e28f5854ab4018925cc876cf892bc2, entries=4, sequenceid=13, filesize=5.5 K 2023-11-25 12:55:55,273 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family2/91594c4d7dbf4334ba7136b5526096e0 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/91594c4d7dbf4334ba7136b5526096e0 2023-11-25 12:55:55,277 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/aac94a443ed44c05820764c51911f949, entries=2, sequenceid=13, filesize=5.1 K 2023-11-25 12:55:55,277 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5f338262d368d869dcf38f98b5e0eb5d in 1339ms, sequenceid=13, compaction requested=true 2023-11-25 12:55:55,277 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/91594c4d7dbf4334ba7136b5526096e0, entries=2, sequenceid=13, filesize=5.1 K 2023-11-25 12:55:55,277 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 5f338262d368d869dcf38f98b5e0eb5d: 2023-11-25 12:55:55,277 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:55,278 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:55:55,280 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e9128328793d2459a3b3db7860adadac in 1342ms, sequenceid=13, compaction requested=true 2023-11-25 12:55:55,280 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e9128328793d2459a3b3db7860adadac: 2023-11-25 12:55:55,280 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:55,280 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:55:55,280 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:55:55,280 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,280 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-25 12:55:55,280 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-25 12:55:55,282 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:55,282 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:55,283 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:55,283 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:55,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-25 12:55:55,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22ec55f[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:55,284 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-25 12:55:55,284 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:55,285 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:55,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:55,285 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-25 12:55:55,285 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-25 12:55:55,286 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:55,286 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,286 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:55,289 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,289 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-25 12:55:55,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:55,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:55,289 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:55,289 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-25 12:55:55,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:55,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:55,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-25 12:55:55,292 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-25 12:55:55,292 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:55,292 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:55,292 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-25 12:55:55,292 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:55,295 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:55,295 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:55,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:55,295 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:55,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:55,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:55,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:55,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:55,297 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:55,298 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,301 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,301 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:55,301 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:55,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:55,301 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:55,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-25 12:55:55,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:55,301 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:55,301 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:55,301 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:55,302 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:55,302 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:55,302 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:55,302 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:55,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:55,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:55,302 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:55,402 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:55,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:55,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:55,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:55,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. with WAL disabled. Data may be lost in the event of a crash. 2023-11-25 12:55:55,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:55,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:55,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-25 12:55:55,408 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-25 12:55:55,408 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:55,409 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-25 12:55:55,409 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-25 12:55:55,409 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:55,409 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:55,410 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:55,410 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:55,411 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:55,411 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:55,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:55,412 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-25 12:55:55,412 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-25 12:55:55,412 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-25 12:55:55,412 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-25 12:55:55,412 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:55,412 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-25 12:55:55,412 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:55,412 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. started... 2023-11-25 12:55:55,412 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:55:55,412 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:55,412 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:55,412 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e9128328793d2459a3b3db7860adadac 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-25 12:55:55,412 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:55,412 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. started... 2023-11-25 12:55:55,413 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. started... 2023-11-25 12:55:55,413 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 5f338262d368d869dcf38f98b5e0eb5d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-25 12:55:55,413 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 26762a13b8f4e0904821d5326eb08429 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-25 12:55:55,468 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125eb023a92055f43edafb73f2de26abf89 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231125eb023a92055f43edafb73f2de26abf89 2023-11-25 12:55:55,473 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311254dff2d45f4694fc4893b77e6ac9e51ee to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311254dff2d45f4694fc4893b77e6ac9e51ee 2023-11-25 12:55:55,490 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family1/7fb277ee27a748e1b90a0dd3eb123378 2023-11-25 12:55:55,867 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311251d96b41fa8c84f12a6d324f2d9f074ed to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311251d96b41fa8c84f12a6d324f2d9f074ed 2023-11-25 12:55:55,884 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family1/2378aa90447748bc90be8db35bf60034 2023-11-25 12:55:55,928 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311256b44103762a649a3b717acbdab0826ba to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311256b44103762a649a3b717acbdab0826ba 2023-11-25 12:55:56,282 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family1/e8ec206e0fc64ad39c423ec1a4c08f36 2023-11-25 12:55:56,315 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125ab0e8d19505d4d19b510a37a05e899eb to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231125ab0e8d19505d4d19b510a37a05e899eb 2023-11-25 12:55:56,319 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family2/5d88ef8ff518423fb31797ffd39cdd94 2023-11-25 12:55:56,322 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family1/2378aa90447748bc90be8db35bf60034 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/2378aa90447748bc90be8db35bf60034 2023-11-25 12:55:56,332 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family2/20171eaec526456ea89c2dfa77d5d9c3 2023-11-25 12:55:56,335 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family1/7fb277ee27a748e1b90a0dd3eb123378 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/7fb277ee27a748e1b90a0dd3eb123378 2023-11-25 12:55:56,347 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/2378aa90447748bc90be8db35bf60034, entries=4, sequenceid=17, filesize=5.5 K 2023-11-25 12:55:56,347 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family2/5d88ef8ff518423fb31797ffd39cdd94 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/5d88ef8ff518423fb31797ffd39cdd94 2023-11-25 12:55:56,351 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/5d88ef8ff518423fb31797ffd39cdd94, entries=2, sequenceid=17, filesize=5.1 K 2023-11-25 12:55:56,351 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5f338262d368d869dcf38f98b5e0eb5d in 938ms, sequenceid=17, compaction requested=true 2023-11-25 12:55:56,351 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 5f338262d368d869dcf38f98b5e0eb5d: 2023-11-25 12:55:56,351 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:56,351 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:55:56,356 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/7fb277ee27a748e1b90a0dd3eb123378, entries=4, sequenceid=17, filesize=5.5 K 2023-11-25 12:55:56,357 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family2/20171eaec526456ea89c2dfa77d5d9c3 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/20171eaec526456ea89c2dfa77d5d9c3 2023-11-25 12:55:56,360 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/20171eaec526456ea89c2dfa77d5d9c3, entries=2, sequenceid=17, filesize=5.1 K 2023-11-25 12:55:56,361 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e9128328793d2459a3b3db7860adadac in 949ms, sequenceid=17, compaction requested=true 2023-11-25 12:55:56,361 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e9128328793d2459a3b3db7860adadac: 2023-11-25 12:55:56,361 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:56,361 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:55:56,714 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311250a808a7071734de2b842f1c37ec66fce to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311250a808a7071734de2b842f1c37ec66fce 2023-11-25 12:55:57,119 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family2/94be7652e88c4c8e9df7ba0c6a25d8b5 2023-11-25 12:55:57,124 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family1/e8ec206e0fc64ad39c423ec1a4c08f36 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/e8ec206e0fc64ad39c423ec1a4c08f36 2023-11-25 12:55:57,153 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/e8ec206e0fc64ad39c423ec1a4c08f36, entries=4, sequenceid=17, filesize=5.5 K 2023-11-25 12:55:57,154 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family2/94be7652e88c4c8e9df7ba0c6a25d8b5 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/94be7652e88c4c8e9df7ba0c6a25d8b5 2023-11-25 12:55:57,160 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/94be7652e88c4c8e9df7ba0c6a25d8b5, entries=2, sequenceid=17, filesize=5.1 K 2023-11-25 12:55:57,161 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 26762a13b8f4e0904821d5326eb08429 in 1748ms, sequenceid=17, compaction requested=true 2023-11-25 12:55:57,161 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 26762a13b8f4e0904821d5326eb08429: 2023-11-25 12:55:57,161 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:57,161 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:55:57,161 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:55:57,161 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,161 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-25 12:55:57,161 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-25 12:55:57,163 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:57,163 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:57,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:57,164 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:57,164 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:57,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:57,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:57,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:57,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:57,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-25 12:55:57,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@575e03eb[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:57,166 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-25 12:55:57,166 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:57,170 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:57,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:57,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-25 12:55:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-25 12:55:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:57,170 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,170 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:57,173 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-25 12:55:57,173 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:57,173 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,173 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-25 12:55:57,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:57,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:57,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:57,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:57,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:57,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:57,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:57,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:57,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-25 12:55:57,177 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-25 12:55:57,177 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:57,177 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:57,177 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-25 12:55:57,177 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:57,179 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:57,180 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:57,180 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:57,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:57,180 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:57,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:57,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:57,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:57,182 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,185 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,185 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:57,185 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:57,185 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,185 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:57,185 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:57,185 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:57,186 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:57,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:57,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:57,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-25 12:55:57,186 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:57,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-25 12:55:57,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:57,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:57,186 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:57,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:57,187 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:57,187 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:57,287 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:57,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:57,302 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:57,311 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:57,321 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:55:57,322 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:55:57,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-25 12:55:57,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-25 12:55:57,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-25 12:55:57,435 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-25 12:55:57,435 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:57,435 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-25 12:55:57,435 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-25 12:55:57,436 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:57,436 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:57,437 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:57,437 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:57,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:57,437 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:57,437 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-25 12:55:57,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:57,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:57,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-25 12:55:57,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:57,438 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-25 12:55:57,438 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-25 12:55:57,438 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-25 12:55:57,438 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-25 12:55:57,438 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-25 12:55:57,439 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-25 12:55:57,439 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:57,439 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. started... 2023-11-25 12:55:57,439 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e9128328793d2459a3b3db7860adadac 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-25 12:55:57,439 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:57,439 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. started... 2023-11-25 12:55:57,440 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-25 12:55:57,440 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 5f338262d368d869dcf38f98b5e0eb5d 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-25 12:55:57,440 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:57,440 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-25 12:55:57,440 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. started... 2023-11-25 12:55:57,440 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 26762a13b8f4e0904821d5326eb08429 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-25 12:55:57,481 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family1/4a0438d799a142eeb86de9f3c365d515 2023-11-25 12:55:57,509 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a0438d799a142eeb86de9f3c365d515 2023-11-25 12:55:57,902 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family1/f4db1c140df94bc6968db1bbc0e9d084 2023-11-25 12:55:57,925 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f4db1c140df94bc6968db1bbc0e9d084 2023-11-25 12:55:58,275 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family1/44b9a94cb6614603b21f1e05cb9b2b88 2023-11-25 12:55:58,299 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44b9a94cb6614603b21f1e05cb9b2b88 2023-11-25 12:55:58,321 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family2/d59469250f364774aa69b27789a26748 2023-11-25 12:55:58,324 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d59469250f364774aa69b27789a26748 2023-11-25 12:55:58,325 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family1/4a0438d799a142eeb86de9f3c365d515 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/4a0438d799a142eeb86de9f3c365d515 2023-11-25 12:55:58,349 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a0438d799a142eeb86de9f3c365d515 2023-11-25 12:55:58,349 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/4a0438d799a142eeb86de9f3c365d515, entries=3, sequenceid=23, filesize=5.2 K 2023-11-25 12:55:58,349 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family2/d59469250f364774aa69b27789a26748 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/d59469250f364774aa69b27789a26748 2023-11-25 12:55:58,353 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d59469250f364774aa69b27789a26748 2023-11-25 12:55:58,353 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/d59469250f364774aa69b27789a26748, entries=1, sequenceid=23, filesize=5.0 K 2023-11-25 12:55:58,354 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5f338262d368d869dcf38f98b5e0eb5d in 914ms, sequenceid=23, compaction requested=true 2023-11-25 12:55:58,354 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 5f338262d368d869dcf38f98b5e0eb5d: 2023-11-25 12:55:58,354 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:55:58,354 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-25 12:55:58,712 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family2/fa730e01be914788840237cccdf8c76a 2023-11-25 12:55:58,715 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa730e01be914788840237cccdf8c76a 2023-11-25 12:55:58,716 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family1/44b9a94cb6614603b21f1e05cb9b2b88 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/44b9a94cb6614603b21f1e05cb9b2b88 2023-11-25 12:55:58,735 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family2/3c9acab08ab24c0180fe8626e3605f7c 2023-11-25 12:55:58,737 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c9acab08ab24c0180fe8626e3605f7c 2023-11-25 12:55:58,738 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family1/f4db1c140df94bc6968db1bbc0e9d084 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/f4db1c140df94bc6968db1bbc0e9d084 2023-11-25 12:55:58,740 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44b9a94cb6614603b21f1e05cb9b2b88 2023-11-25 12:55:58,740 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/44b9a94cb6614603b21f1e05cb9b2b88, entries=3, sequenceid=23, filesize=5.2 K 2023-11-25 12:55:58,741 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family2/fa730e01be914788840237cccdf8c76a as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/fa730e01be914788840237cccdf8c76a 2023-11-25 12:55:58,744 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa730e01be914788840237cccdf8c76a 2023-11-25 12:55:58,744 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/fa730e01be914788840237cccdf8c76a, entries=1, sequenceid=23, filesize=5.0 K 2023-11-25 12:55:58,745 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 26762a13b8f4e0904821d5326eb08429 in 1305ms, sequenceid=23, compaction requested=true 2023-11-25 12:55:58,745 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 26762a13b8f4e0904821d5326eb08429: 2023-11-25 12:55:58,745 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:55:58,745 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-25 12:55:58,761 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f4db1c140df94bc6968db1bbc0e9d084 2023-11-25 12:55:58,762 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/f4db1c140df94bc6968db1bbc0e9d084, entries=3, sequenceid=23, filesize=5.2 K 2023-11-25 12:55:58,762 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family2/3c9acab08ab24c0180fe8626e3605f7c as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/3c9acab08ab24c0180fe8626e3605f7c 2023-11-25 12:55:58,765 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c9acab08ab24c0180fe8626e3605f7c 2023-11-25 12:55:58,765 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/3c9acab08ab24c0180fe8626e3605f7c, entries=1, sequenceid=23, filesize=5.0 K 2023-11-25 12:55:58,766 INFO [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e9128328793d2459a3b3db7860adadac in 1327ms, sequenceid=23, compaction requested=true 2023-11-25 12:55:58,766 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e9128328793d2459a3b3db7860adadac: 2023-11-25 12:55:58,766 DEBUG [rs(jenkins-hbase4.apache.org,37051,1700916801082)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:58,766 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-25 12:55:58,766 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-25 12:55:58,766 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:58,766 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-25 12:55:58,766 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-25 12:55:58,769 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:58,769 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:58,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:58,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:58,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:58,769 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:58,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:58,769 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-25 12:55:58,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:58,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:58,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:58,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:58,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37051,1700916801082' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-25 12:55:58,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26f3a3[Count = 0] remaining members to acquire global barrier 2023-11-25 12:55:58,771 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-25 12:55:58,771 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:58,772 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:58,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:58,772 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-25 12:55:58,772 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-25 12:55:58,772 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:58,772 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-25 12:55:58,772 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,37051,1700916801082' in zk 2023-11-25 12:55:58,773 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:58,773 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-25 12:55:58,773 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:58,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:58,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:58,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:58,773 DEBUG [member: 'jenkins-hbase4.apache.org,37051,1700916801082' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-25 12:55:58,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:58,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:58,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:58,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:58,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:58,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:58,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:58,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,37051,1700916801082': 2023-11-25 12:55:58,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37051,1700916801082' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-25 12:55:58,776 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-25 12:55:58,776 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-25 12:55:58,776 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-25 12:55:58,776 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-25 12:55:58,776 INFO [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-25 12:55:58,777 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:58,777 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:58,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:58,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-25 12:55:58,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-25 12:55:58,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:58,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:58,777 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:58,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:58,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:58,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-25 12:55:58,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:58,778 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:58,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-25 12:55:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:58,779 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-25 12:55:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-25 12:55:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:58,782 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:58,782 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-25 12:55:58,782 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:58,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-25 12:55:58,782 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-25 12:55:58,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-25 12:55:58,782 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-25 12:55:58,782 DEBUG [(jenkins-hbase4.apache.org,38201,1700916799909)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-25 12:55:58,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-25 12:55:58,783 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:55:58,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-25 12:55:58,783 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-25 12:55:58,783 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-25 12:55:58,783 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:58,783 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-25 12:55:58,783 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-25 12:55:58,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-25 12:55:58,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-25 12:55:58,883 DEBUG [Listener at localhost/45289] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-25 12:55:58,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-25 12:55:58,884 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:55:58,884 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): e9128328793d2459a3b3db7860adadac/family1 is initiating major compaction (all files) 2023-11-25 12:55:58,884 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:55:58,885 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:55:58,885 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of e9128328793d2459a3b3db7860adadac/family1 in testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:55:58,885 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/be931a340d3244b49864b0f2c3ec4db0, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/d85d2a0c5f924ce9bc67a94185f5f1e6, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/e1e28f5854ab4018925cc876cf892bc2, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/7fb277ee27a748e1b90a0dd3eb123378, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/f4db1c140df94bc6968db1bbc0e9d084] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp, totalSize=27.1 K 2023-11-25 12:55:58,885 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting be931a340d3244b49864b0f2c3ec4db0, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916950556 2023-11-25 12:55:58,886 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting d85d2a0c5f924ce9bc67a94185f5f1e6, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916952042 2023-11-25 12:55:58,886 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting e1e28f5854ab4018925cc876cf892bc2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916953929 2023-11-25 12:55:58,886 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 7fb277ee27a748e1b90a0dd3eb123378, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916955404 2023-11-25 12:55:58,886 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting f4db1c140df94bc6968db1bbc0e9d084, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-25 12:55:58,895 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): e9128328793d2459a3b3db7860adadac#family1#compaction#196 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:55:59,335 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231125d06bbd702af247139af9c0178a81c312_del 2023-11-25 12:55:59,335 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125d06bbd702af247139af9c0178a81c312_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231125d06bbd702af247139af9c0178a81c312_del 2023-11-25 12:56:00,187 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a4095677e6a4da5a1d8d71e69d4852d 2023-11-25 12:56:00,187 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family1/0a4095677e6a4da5a1d8d71e69d4852d as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/0a4095677e6a4da5a1d8d71e69d4852d 2023-11-25 12:56:00,208 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a4095677e6a4da5a1d8d71e69d4852d 2023-11-25 12:56:00,209 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e9128328793d2459a3b3db7860adadac/family1 of e9128328793d2459a3b3db7860adadac into 0a4095677e6a4da5a1d8d71e69d4852d(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:56:00,209 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for e9128328793d2459a3b3db7860adadac: 2023-11-25 12:56:00,209 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:56:00,209 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): e9128328793d2459a3b3db7860adadac/family2 is initiating major compaction (all files) 2023-11-25 12:56:00,209 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:56:00,209 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:56:00,210 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of e9128328793d2459a3b3db7860adadac/family2 in testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:56:00,210 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/4120949d6a1c48a9b9b143712c576305, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/81df0b1be3164f87921f2bec959e8d06, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/91594c4d7dbf4334ba7136b5526096e0, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/20171eaec526456ea89c2dfa77d5d9c3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/3c9acab08ab24c0180fe8626e3605f7c] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp, totalSize=25.4 K 2023-11-25 12:56:00,210 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 4120949d6a1c48a9b9b143712c576305, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916950556 2023-11-25 12:56:00,210 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 81df0b1be3164f87921f2bec959e8d06, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916952042 2023-11-25 12:56:00,211 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 91594c4d7dbf4334ba7136b5526096e0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916953929 2023-11-25 12:56:00,211 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 20171eaec526456ea89c2dfa77d5d9c3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916955404 2023-11-25 12:56:00,211 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 3c9acab08ab24c0180fe8626e3605f7c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-25 12:56:00,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/be931a340d3244b49864b0f2c3ec4db0, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/d85d2a0c5f924ce9bc67a94185f5f1e6, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/e1e28f5854ab4018925cc876cf892bc2, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/7fb277ee27a748e1b90a0dd3eb123378, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/f4db1c140df94bc6968db1bbc0e9d084] to archive 2023-11-25 12:56:00,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:56:00,216 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/be931a340d3244b49864b0f2c3ec4db0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/be931a340d3244b49864b0f2c3ec4db0 2023-11-25 12:56:00,217 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/d85d2a0c5f924ce9bc67a94185f5f1e6 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/d85d2a0c5f924ce9bc67a94185f5f1e6 2023-11-25 12:56:00,218 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/e1e28f5854ab4018925cc876cf892bc2 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/e1e28f5854ab4018925cc876cf892bc2 2023-11-25 12:56:00,219 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): e9128328793d2459a3b3db7860adadac#family2#compaction#197 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:56:00,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/7fb277ee27a748e1b90a0dd3eb123378 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/7fb277ee27a748e1b90a0dd3eb123378 2023-11-25 12:56:00,220 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/f4db1c140df94bc6968db1bbc0e9d084 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/f4db1c140df94bc6968db1bbc0e9d084 2023-11-25 12:56:00,626 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231125202405233f954f07bd4b8e6da27f3a76_del 2023-11-25 12:56:00,627 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125202405233f954f07bd4b8e6da27f3a76_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231125202405233f954f07bd4b8e6da27f3a76_del 2023-11-25 12:56:01,439 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87eef9b759a74023b9f2db914a7b9892 2023-11-25 12:56:01,440 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/.tmp/family2/87eef9b759a74023b9f2db914a7b9892 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/87eef9b759a74023b9f2db914a7b9892 2023-11-25 12:56:01,444 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87eef9b759a74023b9f2db914a7b9892 2023-11-25 12:56:01,445 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e9128328793d2459a3b3db7860adadac/family2 of e9128328793d2459a3b3db7860adadac into 87eef9b759a74023b9f2db914a7b9892(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:56:01,445 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for e9128328793d2459a3b3db7860adadac: 2023-11-25 12:56:01,446 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:56:01,446 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): 5f338262d368d869dcf38f98b5e0eb5d/family1 is initiating major compaction (all files) 2023-11-25 12:56:01,446 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:56:01,446 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:56:01,447 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of 5f338262d368d869dcf38f98b5e0eb5d/family1 in testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:56:01,447 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/d789d9617e3441718e62f4e04548661a, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/ea4b9a15770b4c64b3feaa3cf93bf4b5, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/289035911ca7468f95369a53c03455ac, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/2378aa90447748bc90be8db35bf60034, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/4a0438d799a142eeb86de9f3c365d515] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp, totalSize=27.1 K 2023-11-25 12:56:01,447 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting d789d9617e3441718e62f4e04548661a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916950556 2023-11-25 12:56:01,448 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting ea4b9a15770b4c64b3feaa3cf93bf4b5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916952042 2023-11-25 12:56:01,448 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 289035911ca7468f95369a53c03455ac, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916953929 2023-11-25 12:56:01,449 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 2378aa90447748bc90be8db35bf60034, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916955404 2023-11-25 12:56:01,449 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 4a0438d799a142eeb86de9f3c365d515, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-25 12:56:01,460 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): 5f338262d368d869dcf38f98b5e0eb5d#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:56:01,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/4120949d6a1c48a9b9b143712c576305, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/81df0b1be3164f87921f2bec959e8d06, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/91594c4d7dbf4334ba7136b5526096e0, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/20171eaec526456ea89c2dfa77d5d9c3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/3c9acab08ab24c0180fe8626e3605f7c] to archive 2023-11-25 12:56:01,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:56:01,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/4120949d6a1c48a9b9b143712c576305 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/4120949d6a1c48a9b9b143712c576305 2023-11-25 12:56:01,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/81df0b1be3164f87921f2bec959e8d06 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/81df0b1be3164f87921f2bec959e8d06 2023-11-25 12:56:01,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/91594c4d7dbf4334ba7136b5526096e0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/91594c4d7dbf4334ba7136b5526096e0 2023-11-25 12:56:01,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/20171eaec526456ea89c2dfa77d5d9c3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/20171eaec526456ea89c2dfa77d5d9c3 2023-11-25 12:56:01,527 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/3c9acab08ab24c0180fe8626e3605f7c to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family2/3c9acab08ab24c0180fe8626e3605f7c 2023-11-25 12:56:01,915 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231125ebe028a6be4541ef9fd262a5b93979b4_del 2023-11-25 12:56:01,915 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125ebe028a6be4541ef9fd262a5b93979b4_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231125ebe028a6be4541ef9fd262a5b93979b4_del 2023-11-25 12:56:02,379 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c7dd58cc737422ca17e63ad45741559 2023-11-25 12:56:02,379 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family1/0c7dd58cc737422ca17e63ad45741559 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/0c7dd58cc737422ca17e63ad45741559 2023-11-25 12:56:02,401 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c7dd58cc737422ca17e63ad45741559 2023-11-25 12:56:02,402 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5f338262d368d869dcf38f98b5e0eb5d/family1 of 5f338262d368d869dcf38f98b5e0eb5d into 0c7dd58cc737422ca17e63ad45741559(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:56:02,402 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for 5f338262d368d869dcf38f98b5e0eb5d: 2023-11-25 12:56:02,402 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:56:02,402 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): 5f338262d368d869dcf38f98b5e0eb5d/family2 is initiating major compaction (all files) 2023-11-25 12:56:02,403 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:56:02,403 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:56:02,403 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of 5f338262d368d869dcf38f98b5e0eb5d/family2 in testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:56:02,403 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/429cfa50e25e4f939e96140b245a25fe, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/7be4c940009140e2acb6f1396f910ffb, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/aac94a443ed44c05820764c51911f949, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/5d88ef8ff518423fb31797ffd39cdd94, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/d59469250f364774aa69b27789a26748] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp, totalSize=25.4 K 2023-11-25 12:56:02,403 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 429cfa50e25e4f939e96140b245a25fe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916950556 2023-11-25 12:56:02,403 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 7be4c940009140e2acb6f1396f910ffb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916952042 2023-11-25 12:56:02,404 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting aac94a443ed44c05820764c51911f949, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916953929 2023-11-25 12:56:02,404 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 5d88ef8ff518423fb31797ffd39cdd94, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916955404 2023-11-25 12:56:02,404 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting d59469250f364774aa69b27789a26748, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-25 12:56:02,411 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): 5f338262d368d869dcf38f98b5e0eb5d#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:56:02,414 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/d789d9617e3441718e62f4e04548661a, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/ea4b9a15770b4c64b3feaa3cf93bf4b5, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/289035911ca7468f95369a53c03455ac, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/2378aa90447748bc90be8db35bf60034, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/4a0438d799a142eeb86de9f3c365d515] to archive 2023-11-25 12:56:02,414 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:56:02,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/d789d9617e3441718e62f4e04548661a to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/d789d9617e3441718e62f4e04548661a 2023-11-25 12:56:02,417 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/ea4b9a15770b4c64b3feaa3cf93bf4b5 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/ea4b9a15770b4c64b3feaa3cf93bf4b5 2023-11-25 12:56:02,418 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/289035911ca7468f95369a53c03455ac to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/289035911ca7468f95369a53c03455ac 2023-11-25 12:56:02,419 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/2378aa90447748bc90be8db35bf60034 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/2378aa90447748bc90be8db35bf60034 2023-11-25 12:56:02,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/4a0438d799a142eeb86de9f3c365d515 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/4a0438d799a142eeb86de9f3c365d515 2023-11-25 12:56:02,818 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311253f64b4248aa6439aa82981344ed18c07_del 2023-11-25 12:56:02,819 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311253f64b4248aa6439aa82981344ed18c07_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311253f64b4248aa6439aa82981344ed18c07_del 2023-11-25 12:56:03,233 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9784bfe7514489583ddffdab5d7bb1d 2023-11-25 12:56:03,233 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/.tmp/family2/b9784bfe7514489583ddffdab5d7bb1d as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/b9784bfe7514489583ddffdab5d7bb1d 2023-11-25 12:56:03,237 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9784bfe7514489583ddffdab5d7bb1d 2023-11-25 12:56:03,245 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5f338262d368d869dcf38f98b5e0eb5d/family2 of 5f338262d368d869dcf38f98b5e0eb5d into b9784bfe7514489583ddffdab5d7bb1d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-25 12:56:03,245 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for 5f338262d368d869dcf38f98b5e0eb5d: 2023-11-25 12:56:03,246 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:56:03,246 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): 26762a13b8f4e0904821d5326eb08429/family1 is initiating major compaction (all files) 2023-11-25 12:56:03,246 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:56:03,246 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:56:03,247 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of 26762a13b8f4e0904821d5326eb08429/family1 in testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:56:03,247 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/e99c90bb01194e2486424e0b7855f4de, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/11bef89d5b9f4d2590bee0b9d9715825, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/b850689a2f394f4a854724bacea8188a, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/e8ec206e0fc64ad39c423ec1a4c08f36, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/44b9a94cb6614603b21f1e05cb9b2b88] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp, totalSize=27.1 K 2023-11-25 12:56:03,248 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting e99c90bb01194e2486424e0b7855f4de, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916950556 2023-11-25 12:56:03,248 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 11bef89d5b9f4d2590bee0b9d9715825, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916952042 2023-11-25 12:56:03,249 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting b850689a2f394f4a854724bacea8188a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916953929 2023-11-25 12:56:03,249 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting e8ec206e0fc64ad39c423ec1a4c08f36, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916955404 2023-11-25 12:56:03,249 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 44b9a94cb6614603b21f1e05cb9b2b88, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-25 12:56:03,265 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): 26762a13b8f4e0904821d5326eb08429#family1#compaction#200 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:56:03,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/429cfa50e25e4f939e96140b245a25fe, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/7be4c940009140e2acb6f1396f910ffb, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/aac94a443ed44c05820764c51911f949, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/5d88ef8ff518423fb31797ffd39cdd94, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/d59469250f364774aa69b27789a26748] to archive 2023-11-25 12:56:03,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:56:03,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/429cfa50e25e4f939e96140b245a25fe to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/429cfa50e25e4f939e96140b245a25fe 2023-11-25 12:56:03,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/7be4c940009140e2acb6f1396f910ffb to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/7be4c940009140e2acb6f1396f910ffb 2023-11-25 12:56:03,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/aac94a443ed44c05820764c51911f949 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/aac94a443ed44c05820764c51911f949 2023-11-25 12:56:03,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/5d88ef8ff518423fb31797ffd39cdd94 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/5d88ef8ff518423fb31797ffd39cdd94 2023-11-25 12:56:03,324 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/d59469250f364774aa69b27789a26748 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family2/d59469250f364774aa69b27789a26748 2023-11-25 12:56:03,728 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311251be301a4cffd41c6aaccd3728eb6084e_del 2023-11-25 12:56:03,728 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311251be301a4cffd41c6aaccd3728eb6084e_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311251be301a4cffd41c6aaccd3728eb6084e_del 2023-11-25 12:56:04,586 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-25 12:56:04,589 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3418371b6f542f3922ac38fd4b0c2ca 2023-11-25 12:56:04,590 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family1/c3418371b6f542f3922ac38fd4b0c2ca as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/c3418371b6f542f3922ac38fd4b0c2ca 2023-11-25 12:56:04,611 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3418371b6f542f3922ac38fd4b0c2ca 2023-11-25 12:56:04,612 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 26762a13b8f4e0904821d5326eb08429/family1 of 26762a13b8f4e0904821d5326eb08429 into c3418371b6f542f3922ac38fd4b0c2ca(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:56:04,612 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for 26762a13b8f4e0904821d5326eb08429: 2023-11-25 12:56:04,612 DEBUG [Listener at localhost/45289] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-25 12:56:04,612 DEBUG [Listener at localhost/45289] regionserver.HStore(1912): 26762a13b8f4e0904821d5326eb08429/family2 is initiating major compaction (all files) 2023-11-25 12:56:04,612 INFO [Listener at localhost/45289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-25 12:56:04,613 INFO [Listener at localhost/45289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-25 12:56:04,613 INFO [Listener at localhost/45289] regionserver.HRegion(2259): Starting compaction of 26762a13b8f4e0904821d5326eb08429/family2 in testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:56:04,613 INFO [Listener at localhost/45289] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/2fc8a4ca7fa54004bac3a92469fb41f4, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/c4184b1f910b4f0bb3f9f6bb455dbb2b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/eded7e12344d4e8c814eb6d2235bbee3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/94be7652e88c4c8e9df7ba0c6a25d8b5, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/fa730e01be914788840237cccdf8c76a] into tmpdir=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp, totalSize=25.4 K 2023-11-25 12:56:04,613 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 2fc8a4ca7fa54004bac3a92469fb41f4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700916950556 2023-11-25 12:56:04,613 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting c4184b1f910b4f0bb3f9f6bb455dbb2b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700916952042 2023-11-25 12:56:04,614 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/e99c90bb01194e2486424e0b7855f4de, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/11bef89d5b9f4d2590bee0b9d9715825, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/b850689a2f394f4a854724bacea8188a, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/e8ec206e0fc64ad39c423ec1a4c08f36, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/44b9a94cb6614603b21f1e05cb9b2b88] to archive 2023-11-25 12:56:04,614 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting eded7e12344d4e8c814eb6d2235bbee3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700916953929 2023-11-25 12:56:04,614 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting 94be7652e88c4c8e9df7ba0c6a25d8b5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700916955404 2023-11-25 12:56:04,614 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:56:04,615 DEBUG [Listener at localhost/45289] compactions.Compactor(207): Compacting fa730e01be914788840237cccdf8c76a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-25 12:56:04,616 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/e99c90bb01194e2486424e0b7855f4de to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/e99c90bb01194e2486424e0b7855f4de 2023-11-25 12:56:04,617 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/11bef89d5b9f4d2590bee0b9d9715825 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/11bef89d5b9f4d2590bee0b9d9715825 2023-11-25 12:56:04,618 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/b850689a2f394f4a854724bacea8188a to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/b850689a2f394f4a854724bacea8188a 2023-11-25 12:56:04,620 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/e8ec206e0fc64ad39c423ec1a4c08f36 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/e8ec206e0fc64ad39c423ec1a4c08f36 2023-11-25 12:56:04,621 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/44b9a94cb6614603b21f1e05cb9b2b88 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/44b9a94cb6614603b21f1e05cb9b2b88 2023-11-25 12:56:04,624 INFO [Listener at localhost/45289] throttle.PressureAwareThroughputController(145): 26762a13b8f4e0904821d5326eb08429#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-25 12:56:05,031 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023112511dffca23a754c108834174f3ad9f897_del 2023-11-25 12:56:05,031 INFO [Listener at localhost/45289] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112511dffca23a754c108834174f3ad9f897_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023112511dffca23a754c108834174f3ad9f897_del 2023-11-25 12:56:05,828 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-25 12:56:05,843 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8543c0dc598345b7af26cc04425d78ae 2023-11-25 12:56:05,844 DEBUG [Listener at localhost/45289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/.tmp/family2/8543c0dc598345b7af26cc04425d78ae as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/8543c0dc598345b7af26cc04425d78ae 2023-11-25 12:56:05,847 INFO [Listener at localhost/45289] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8543c0dc598345b7af26cc04425d78ae 2023-11-25 12:56:05,848 INFO [Listener at localhost/45289] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 26762a13b8f4e0904821d5326eb08429/family2 of 26762a13b8f4e0904821d5326eb08429 into 8543c0dc598345b7af26cc04425d78ae(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-25 12:56:05,848 DEBUG [Listener at localhost/45289] regionserver.HRegion(2289): Compaction status journal for 26762a13b8f4e0904821d5326eb08429: 2023-11-25 12:56:05,851 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:56:05,853 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:56:05,856 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:56:05,857 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:56:05,861 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38201] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x1A\xA6\xC9D\xCF\xB3LPI,Dd\xB0\x12\x8F\x12"\x10\xA0V/\xD9\x9C\x8D)\xAC_\x08\xA1t\xA4F\x8Ax*\x10\xBB\x0F\x9E|\x01qu\xC7-\x1C\x14\x1D\xA4\xF39\x132\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-25 12:56:05,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-25 12:56:05,883 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-25 12:56:05,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:56:05,883 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700917565883 2023-11-25 12:56:05,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-25 12:56:05,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/2fc8a4ca7fa54004bac3a92469fb41f4, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/c4184b1f910b4f0bb3f9f6bb455dbb2b, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/eded7e12344d4e8c814eb6d2235bbee3, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/94be7652e88c4c8e9df7ba0c6a25d8b5, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/fa730e01be914788840237cccdf8c76a] to archive 2023-11-25 12:56:05,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:56:05,916 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/2fc8a4ca7fa54004bac3a92469fb41f4 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/2fc8a4ca7fa54004bac3a92469fb41f4 2023-11-25 12:56:05,917 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/c4184b1f910b4f0bb3f9f6bb455dbb2b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/c4184b1f910b4f0bb3f9f6bb455dbb2b 2023-11-25 12:56:05,918 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/eded7e12344d4e8c814eb6d2235bbee3 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/eded7e12344d4e8c814eb6d2235bbee3 2023-11-25 12:56:05,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/94be7652e88c4c8e9df7ba0c6a25d8b5 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/94be7652e88c4c8e9df7ba0c6a25d8b5 2023-11-25 12:56:05,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/fa730e01be914788840237cccdf8c76a to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family2/fa730e01be914788840237cccdf8c76a 2023-11-25 12:56:06,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-25 12:56:06,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311251be301a4cffd41c6aaccd3728eb6084e_del 2023-11-25 12:56:06,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231125ebe028a6be4541ef9fd262a5b93979b4_del 2023-11-25 12:56:06,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231125d06bbd702af247139af9c0178a81c312_del 2023-11-25 12:56:06,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-25 12:56:06,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] zookeeper.ReadOnlyZKClient(139): Connect 0x7a454395 to 127.0.0.1:63200 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-25 12:56:06,279 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7deec2aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-25 12:56:06,279 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231125 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-25 12:56:06,824 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231125283c68a176eb457eac9164e817916f64 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231125283c68a176eb457eac9164e817916f64 2023-11-25 12:56:06,825 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231125 table='testMajorCompactionFromAdmin' column='family1' 2023-11-25 12:56:06,835 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-25 12:56:06,838 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-25 12:56:06,845 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-25 12:56:06,847 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-25 12:56:06,875 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231125/family1/58617070053049deac620a88836b2269 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-25 12:56:06,875 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231125/family1/58617070053049deac620a88836b2269}] 2023-11-25 12:56:06,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231125/family1/58617070053049deac620a88836b2269 for inclusion in 5f338262d368d869dcf38f98b5e0eb5d/family1 2023-11-25 12:56:06,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-25 12:56:06,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-25 12:56:06,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 5f338262d368d869dcf38f98b5e0eb5d: 2023-11-25 12:56:06,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231125/family1/58617070053049deac620a88836b2269 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionFromAdmin__fu47jokqh7cq0t0g4vv2ord2vt7k8aam8ee45om9ev9ch6kkk63459hcpioldmci/family1/58617070053049deac620a88836b2269 2023-11-25 12:56:06,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionFromAdmin__fu47jokqh7cq0t0g4vv2ord2vt7k8aam8ee45om9ev9ch6kkk63459hcpioldmci/family1/58617070053049deac620a88836b2269 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/14973429b45e4adf8b15fd8fc3c70ca4_SeqId_28_ 2023-11-25 12:56:06,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionFromAdmin__fu47jokqh7cq0t0g4vv2ord2vt7k8aam8ee45om9ev9ch6kkk63459hcpioldmci/family1/58617070053049deac620a88836b2269 into 5f338262d368d869dcf38f98b5e0eb5d/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/14973429b45e4adf8b15fd8fc3c70ca4_SeqId_28_ - updating store file list. 2023-11-25 12:56:06,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/14973429b45e4adf8b15fd8fc3c70ca4_SeqId_28_ into 5f338262d368d869dcf38f98b5e0eb5d/family1 2023-11-25 12:56:06,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionFromAdmin__fu47jokqh7cq0t0g4vv2ord2vt7k8aam8ee45om9ev9ch6kkk63459hcpioldmci/family1/58617070053049deac620a88836b2269 into 5f338262d368d869dcf38f98b5e0eb5d/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/family1/14973429b45e4adf8b15fd8fc3c70ca4_SeqId_28_) 2023-11-25 12:56:06,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionFromAdmin__fu47jokqh7cq0t0g4vv2ord2vt7k8aam8ee45om9ev9ch6kkk63459hcpioldmci/family1/58617070053049deac620a88836b2269 2023-11-25 12:56:06,941 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231125 table='testMajorCompactionFromAdmin' column='family1' 2023-11-25 12:56:06,942 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:56:06,943 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023112546e67d2468a74bcdb4a7ee2b9c8bb368 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023112546e67d2468a74bcdb4a7ee2b9c8bb368 2023-11-25 12:56:06,944 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231125a977ebcaa03c432fbac030f0a9d3b0c0 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231125a977ebcaa03c432fbac030f0a9d3b0c0 2023-11-25 12:56:06,945 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231125b2c2aa1be419458db983c99acfd85e79 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231125b2c2aa1be419458db983c99acfd85e79 2023-11-25 12:56:06,946 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231125eb023a92055f43edafb73f2de26abf89 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231125eb023a92055f43edafb73f2de26abf89 2023-11-25 12:56:06,946 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-25 12:56:06,946 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231125' 2023-11-25 12:56:06,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231125 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-25 12:56:06,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231125 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-25 12:56:07,070 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-11-25 12:56:07,515 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112578b9ee389309462a872635034f759d6b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112578b9ee389309462a872635034f759d6b 2023-11-25 12:56:07,516 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231125 table='testMajorCompactionFromAdmin' column='family1' 2023-11-25 12:56:07,557 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231125/family1/e159a6bce73d411bb6a0bd11300e2240 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-25 12:56:07,558 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231125/family1/e159a6bce73d411bb6a0bd11300e2240}] 2023-11-25 12:56:07,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231125/family1/e159a6bce73d411bb6a0bd11300e2240 for inclusion in 26762a13b8f4e0904821d5326eb08429/family1 2023-11-25 12:56:07,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-25 12:56:07,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first= last=1 2023-11-25 12:56:07,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for 26762a13b8f4e0904821d5326eb08429: 2023-11-25 12:56:07,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231125/family1/e159a6bce73d411bb6a0bd11300e2240 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionFromAdmin__91cf502p0tbgiq5om80ijsp5sm2udqm3s8tqi49q2jrhrf4ca0nlfos815b5er2t/family1/e159a6bce73d411bb6a0bd11300e2240 2023-11-25 12:56:07,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionFromAdmin__91cf502p0tbgiq5om80ijsp5sm2udqm3s8tqi49q2jrhrf4ca0nlfos815b5er2t/family1/e159a6bce73d411bb6a0bd11300e2240 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/737ba947d30e4f38b71eb37b17746b09_SeqId_28_ 2023-11-25 12:56:07,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionFromAdmin__91cf502p0tbgiq5om80ijsp5sm2udqm3s8tqi49q2jrhrf4ca0nlfos815b5er2t/family1/e159a6bce73d411bb6a0bd11300e2240 into 26762a13b8f4e0904821d5326eb08429/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/737ba947d30e4f38b71eb37b17746b09_SeqId_28_ - updating store file list. 2023-11-25 12:56:07,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/737ba947d30e4f38b71eb37b17746b09_SeqId_28_ into 26762a13b8f4e0904821d5326eb08429/family1 2023-11-25 12:56:07,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionFromAdmin__91cf502p0tbgiq5om80ijsp5sm2udqm3s8tqi49q2jrhrf4ca0nlfos815b5er2t/family1/e159a6bce73d411bb6a0bd11300e2240 into 26762a13b8f4e0904821d5326eb08429/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/family1/737ba947d30e4f38b71eb37b17746b09_SeqId_28_) 2023-11-25 12:56:07,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionFromAdmin__91cf502p0tbgiq5om80ijsp5sm2udqm3s8tqi49q2jrhrf4ca0nlfos815b5er2t/family1/e159a6bce73d411bb6a0bd11300e2240 2023-11-25 12:56:07,614 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231125 table='testMajorCompactionFromAdmin' column='family1' 2023-11-25 12:56:07,615 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:56:07,616 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311250edd7ed5a5fc442bb1551e28ff0ffd2f to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311250edd7ed5a5fc442bb1551e28ff0ffd2f 2023-11-25 12:56:07,617 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311251d96b41fa8c84f12a6d324f2d9f074ed to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311251d96b41fa8c84f12a6d324f2d9f074ed 2023-11-25 12:56:07,618 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311255d082c77bf9a48ecafa520c07d8db8d8 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311255d082c77bf9a48ecafa520c07d8db8d8 2023-11-25 12:56:07,619 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112578ca2dc976af4fb5aabc3c9c223ef91e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112578ca2dc976af4fb5aabc3c9c223ef91e 2023-11-25 12:56:07,619 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-25 12:56:07,619 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231125' 2023-11-25 12:56:07,619 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231125 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-25 12:56:07,620 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231125 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-25 12:56:08,318 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-11-25 12:56:08,574 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231125ae421dfb1b56453bbda748575c1b8b55 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231125ae421dfb1b56453bbda748575c1b8b55 2023-11-25 12:56:08,576 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231125 table='testMajorCompactionFromAdmin' column='family1' 2023-11-25 12:56:08,617 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231125/family1/2f19b017157a4428a58243032db99600 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-25 12:56:08,618 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac., hostname=jenkins-hbase4.apache.org,37051,1700916801082, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231125/family1/2f19b017157a4428a58243032db99600}] 2023-11-25 12:56:08,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(763): Validating hfile at hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231125/family1/2f19b017157a4428a58243032db99600 for inclusion in e9128328793d2459a3b3db7860adadac/family1 2023-11-25 12:56:08,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-25 12:56:08,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-25 12:56:08,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegion(2446): Flush status journal for e9128328793d2459a3b3db7860adadac: 2023-11-25 12:56:08,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231125/family1/2f19b017157a4428a58243032db99600 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionFromAdmin__rkuqpt0qp8tnsa18nlvp0dl6bh7neqkjvapmeedgn83pqj4mjock1oetc6opjm1t/family1/2f19b017157a4428a58243032db99600 2023-11-25 12:56:08,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionFromAdmin__rkuqpt0qp8tnsa18nlvp0dl6bh7neqkjvapmeedgn83pqj4mjock1oetc6opjm1t/family1/2f19b017157a4428a58243032db99600 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/eb15185078d1446daf157fb4cee28666_SeqId_28_ 2023-11-25 12:56:08,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(849): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionFromAdmin__rkuqpt0qp8tnsa18nlvp0dl6bh7neqkjvapmeedgn83pqj4mjock1oetc6opjm1t/family1/2f19b017157a4428a58243032db99600 into e9128328793d2459a3b3db7860adadac/family1 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/eb15185078d1446daf157fb4cee28666_SeqId_28_ - updating store file list. 2023-11-25 12:56:08,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(882): Loaded HFile hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/eb15185078d1446daf157fb4cee28666_SeqId_28_ into e9128328793d2459a3b3db7860adadac/family1 2023-11-25 12:56:08,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.HStore(855): Successfully loaded hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionFromAdmin__rkuqpt0qp8tnsa18nlvp0dl6bh7neqkjvapmeedgn83pqj4mjock1oetc6opjm1t/family1/2f19b017157a4428a58243032db99600 into e9128328793d2459a3b3db7860adadac/family1 (new location: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/family1/eb15185078d1446daf157fb4cee28666_SeqId_28_) 2023-11-25 12:56:08,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/staging/jenkins__testMajorCompactionFromAdmin__rkuqpt0qp8tnsa18nlvp0dl6bh7neqkjvapmeedgn83pqj4mjock1oetc6opjm1t/family1/2f19b017157a4428a58243032db99600 2023-11-25 12:56:08,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231125 table='testMajorCompactionFromAdmin' column='family1' 2023-11-25 12:56:08,667 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:56:08,668 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311250b67574c60a14fe48827bceb4f736b6b to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311250b67574c60a14fe48827bceb4f736b6b 2023-11-25 12:56:08,669 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231125465fd239b8664afd83612cf21e98f7d7 to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231125465fd239b8664afd83612cf21e98f7d7 2023-11-25 12:56:08,670 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311254dff2d45f4694fc4893b77e6ac9e51ee to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311254dff2d45f4694fc4893b77e6ac9e51ee 2023-11-25 12:56:08,671 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231125a6bacde304704bcdaa40829f1401440e to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231125a6bacde304704bcdaa40829f1401440e 2023-11-25 12:56:08,671 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-25 12:56:08,671 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231125' 2023-11-25 12:56:08,671 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231125 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-25 12:56:08,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-25 12:56:08,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-25 12:56:08,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311251be301a4cffd41c6aaccd3728eb6084e_del] 2023-11-25 12:56:08,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:56:08,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311251be301a4cffd41c6aaccd3728eb6084e_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311251be301a4cffd41c6aaccd3728eb6084e_del 2023-11-25 12:56:08,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-25 12:56:08,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231125ebe028a6be4541ef9fd262a5b93979b4_del] 2023-11-25 12:56:08,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:56:08,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231125ebe028a6be4541ef9fd262a5b93979b4_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231125ebe028a6be4541ef9fd262a5b93979b4_del 2023-11-25 12:56:08,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-25 12:56:08,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231125d06bbd702af247139af9c0178a81c312_del] 2023-11-25 12:56:08,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] backup.HFileArchiver(360): Archiving compacted files. 2023-11-25 12:56:08,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231125d06bbd702af247139af9c0178a81c312_del to hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231125d06bbd702af247139af9c0178a81c312_del 2023-11-25 12:56:08,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-25 12:56:08,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700916805106] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-25 12:56:08,677 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-25 12:56:08,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.7960 sec 2023-11-25 12:56:08,698 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:56:08,700 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:56:08,702 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-25 12:56:08,703 DEBUG [Listener at localhost/45289] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-25 12:56:08,707 INFO [Listener at localhost/45289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-25 12:56:08,743 INFO [Listener at localhost/45289] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=249 (was 257), OpenFileDescriptor=666 (was 678), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 182) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=7482 (was 7987) 2023-11-25 12:56:08,743 DEBUG [Listener at localhost/45289] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2131ff51 to 127.0.0.1:63200 2023-11-25 12:56:08,744 DEBUG [Listener at localhost/45289] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:56:08,744 INFO [Listener at localhost/45289] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-25 12:56:08,744 INFO [Listener at localhost/45289] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-25 12:56:08,744 DEBUG [Listener at localhost/45289] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42f95205 to 127.0.0.1:63200 2023-11-25 12:56:08,744 DEBUG [Listener at localhost/45289] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:56:08,744 DEBUG [Listener at localhost/45289] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-25 12:56:08,744 DEBUG [Listener at localhost/45289] util.JVMClusterUtil(257): Found active master hash=179001302, stopped=false 2023-11-25 12:56:08,744 INFO [Listener at localhost/45289] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38201,1700916799909 2023-11-25 12:56:08,746 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-25 12:56:08,746 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-25 12:56:08,746 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-25 12:56:08,746 INFO [Listener at localhost/45289] procedure2.ProcedureExecutor(628): Stopping 2023-11-25 12:56:08,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-25 12:56:08,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-25 12:56:08,746 DEBUG [Listener at localhost/45289] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x093c56c0 to 127.0.0.1:63200 2023-11-25 12:56:08,747 DEBUG [Listener at localhost/45289] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:56:08,747 INFO [Listener at localhost/45289] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,37051,1700916801082' ***** 2023-11-25 12:56:08,747 INFO [Listener at localhost/45289] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2023-11-25 12:56:08,747 INFO [RS:0;jenkins-hbase4:37051] regionserver.HeapMemoryManager(220): Stopping 2023-11-25 12:56:08,747 INFO [RS:0;jenkins-hbase4:37051] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-25 12:56:08,747 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for 429309f3707a667a7044d0fa7d8d576d 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for cbe8aab5265ba45057cccb680074a732 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for c902f29bb39df121448280b255efeb4d 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for e9128328793d2459a3b3db7860adadac 2023-11-25 12:56:08,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 429309f3707a667a7044d0fa7d8d576d, disabling compactions & flushes 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for b003b003481e082b6bae5bad39b1e617 2023-11-25 12:56:08,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for bddfe0320af31574f2d4a9b59b62fc35 2023-11-25 12:56:08,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for 27807dc9fc4b004f8aed835c4201af39 2023-11-25 12:56:08,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. after waiting 0 ms 2023-11-25 12:56:08,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for b24fcdd00cf9bdd24601c4776c94f7ff 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for e610b0aabe2bce69b899dd05ec92035a 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for e8a9f5a78223694384a6169ce0365c9e 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for 83bb1fd938e2dac427ea10eb612df94b 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for 28de3526844060bb212fbaedf7d89ec8 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for 5f338262d368d869dcf38f98b5e0eb5d 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for a5af6d2effa8ff8710911206706bc4ff 2023-11-25 12:56:08,748 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for 67ff462843156320a06b388981969e08 2023-11-25 12:56:08,749 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for 26762a13b8f4e0904821d5326eb08429 2023-11-25 12:56:08,749 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for e2b716da1809d768d144f498d4caadc1 2023-11-25 12:56:08,749 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for c57e11eaeca2312f287d1e59e1894d94 2023-11-25 12:56:08,749 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for 1ec2e29f51499fb50f28c15f7410a96e 2023-11-25 12:56:08,749 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for 01cde85952d5e08a35d21599fa528f30 2023-11-25 12:56:08,749 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:56:08,749 DEBUG [RS:0;jenkins-hbase4:37051] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x143d412e to 127.0.0.1:63200 2023-11-25 12:56:08,749 DEBUG [RS:0;jenkins-hbase4:37051] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:56:08,749 INFO [RS:0;jenkins-hbase4:37051] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-25 12:56:08,749 INFO [RS:0;jenkins-hbase4:37051] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-25 12:56:08,749 INFO [RS:0;jenkins-hbase4:37051] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-25 12:56:08,749 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(3308): Received CLOSE for 1588230740 2023-11-25 12:56:08,750 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1477): Waiting on 21 regions to close 2023-11-25 12:56:08,750 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-25 12:56:08,750 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-25 12:56:08,750 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-25 12:56:08,750 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-25 12:56:08,750 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-25 12:56:08,750 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-25 12:56:08,750 DEBUG [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1507): Waiting on 01cde85952d5e08a35d21599fa528f30, 1588230740, 1ec2e29f51499fb50f28c15f7410a96e, 26762a13b8f4e0904821d5326eb08429, 27807dc9fc4b004f8aed835c4201af39, 28de3526844060bb212fbaedf7d89ec8, 429309f3707a667a7044d0fa7d8d576d, 5f338262d368d869dcf38f98b5e0eb5d, 67ff462843156320a06b388981969e08, 83bb1fd938e2dac427ea10eb612df94b, a5af6d2effa8ff8710911206706bc4ff, b003b003481e082b6bae5bad39b1e617, b24fcdd00cf9bdd24601c4776c94f7ff, bddfe0320af31574f2d4a9b59b62fc35, c57e11eaeca2312f287d1e59e1894d94, c902f29bb39df121448280b255efeb4d, cbe8aab5265ba45057cccb680074a732, e2b716da1809d768d144f498d4caadc1, e610b0aabe2bce69b899dd05ec92035a, e8a9f5a78223694384a6169ce0365c9e, e9128328793d2459a3b3db7860adadac 2023-11-25 12:56:08,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/429309f3707a667a7044d0fa7d8d576d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-25 12:56:08,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:56:08,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 429309f3707a667a7044d0fa7d8d576d: 2023-11-25 12:56:08,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1700916918027.429309f3707a667a7044d0fa7d8d576d. 2023-11-25 12:56:08,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cbe8aab5265ba45057cccb680074a732, disabling compactions & flushes 2023-11-25 12:56:08,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:56:08,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:56:08,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. after waiting 0 ms 2023-11-25 12:56:08,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:56:08,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/cbe8aab5265ba45057cccb680074a732/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-25 12:56:08,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:56:08,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cbe8aab5265ba45057cccb680074a732: 2023-11-25 12:56:08,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1700916839850.cbe8aab5265ba45057cccb680074a732. 2023-11-25 12:56:08,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c902f29bb39df121448280b255efeb4d, disabling compactions & flushes 2023-11-25 12:56:08,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:56:08,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:56:08,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. after waiting 0 ms 2023-11-25 12:56:08,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:56:08,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/c902f29bb39df121448280b255efeb4d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-25 12:56:08,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:56:08,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c902f29bb39df121448280b255efeb4d: 2023-11-25 12:56:08,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1700916918027.c902f29bb39df121448280b255efeb4d. 2023-11-25 12:56:08,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e9128328793d2459a3b3db7860adadac, disabling compactions & flushes 2023-11-25 12:56:08,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:56:08,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:56:08,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. after waiting 0 ms 2023-11-25 12:56:08,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:56:08,773 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-25 12:56:08,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/e9128328793d2459a3b3db7860adadac/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-25 12:56:08,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:56:08,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e9128328793d2459a3b3db7860adadac: 2023-11-25 12:56:08,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1700916948413.e9128328793d2459a3b3db7860adadac. 2023-11-25 12:56:08,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b003b003481e082b6bae5bad39b1e617, disabling compactions & flushes 2023-11-25 12:56:08,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:56:08,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:56:08,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. after waiting 0 ms 2023-11-25 12:56:08,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:56:08,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/b003b003481e082b6bae5bad39b1e617/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-25 12:56:08,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:56:08,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b003b003481e082b6bae5bad39b1e617: 2023-11-25 12:56:08,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1700916893094.b003b003481e082b6bae5bad39b1e617. 2023-11-25 12:56:08,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bddfe0320af31574f2d4a9b59b62fc35, disabling compactions & flushes 2023-11-25 12:56:08,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:56:08,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:56:08,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. after waiting 0 ms 2023-11-25 12:56:08,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:56:08,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithMonthlyPolicy/bddfe0320af31574f2d4a9b59b62fc35/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-25 12:56:08,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:56:08,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bddfe0320af31574f2d4a9b59b62fc35: 2023-11-25 12:56:08,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1700916934836.bddfe0320af31574f2d4a9b59b62fc35. 2023-11-25 12:56:08,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 27807dc9fc4b004f8aed835c4201af39, disabling compactions & flushes 2023-11-25 12:56:08,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:56:08,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:56:08,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. after waiting 0 ms 2023-11-25 12:56:08,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:56:08,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMinorCompactionWithWeeklyPolicy/27807dc9fc4b004f8aed835c4201af39/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-25 12:56:08,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:56:08,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 27807dc9fc4b004f8aed835c4201af39: 2023-11-25 12:56:08,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1700916828476.27807dc9fc4b004f8aed835c4201af39. 2023-11-25 12:56:08,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b24fcdd00cf9bdd24601c4776c94f7ff, disabling compactions & flushes 2023-11-25 12:56:08,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:56:08,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:56:08,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. after waiting 0 ms 2023-11-25 12:56:08,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:56:08,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithMonthlyPolicy/b24fcdd00cf9bdd24601c4776c94f7ff/recovered.edits/51.seqid, newMaxSeqId=51, maxSeqId=1 2023-11-25 12:56:08,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:56:08,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b24fcdd00cf9bdd24601c4776c94f7ff: 2023-11-25 12:56:08,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1700916817556.b24fcdd00cf9bdd24601c4776c94f7ff. 2023-11-25 12:56:08,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e610b0aabe2bce69b899dd05ec92035a, disabling compactions & flushes 2023-11-25 12:56:08,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:56:08,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:56:08,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. after waiting 0 ms 2023-11-25 12:56:08,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:56:08,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyPolicy/e610b0aabe2bce69b899dd05ec92035a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-25 12:56:08,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:56:08,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e610b0aabe2bce69b899dd05ec92035a: 2023-11-25 12:56:08,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1700916844894.e610b0aabe2bce69b899dd05ec92035a. 2023-11-25 12:56:08,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e8a9f5a78223694384a6169ce0365c9e, disabling compactions & flushes 2023-11-25 12:56:08,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:56:08,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:56:08,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. after waiting 0 ms 2023-11-25 12:56:08,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:56:08,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e8a9f5a78223694384a6169ce0365c9e/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-25 12:56:08,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:56:08,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e8a9f5a78223694384a6169ce0365c9e: 2023-11-25 12:56:08,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700916858230.e8a9f5a78223694384a6169ce0365c9e. 2023-11-25 12:56:08,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 83bb1fd938e2dac427ea10eb612df94b, disabling compactions & flushes 2023-11-25 12:56:08,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:56:08,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:56:08,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. after waiting 0 ms 2023-11-25 12:56:08,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:56:08,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/83bb1fd938e2dac427ea10eb612df94b/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-25 12:56:08,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:56:08,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 83bb1fd938e2dac427ea10eb612df94b: 2023-11-25 12:56:08,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1700916893094.83bb1fd938e2dac427ea10eb612df94b. 2023-11-25 12:56:08,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 28de3526844060bb212fbaedf7d89ec8, disabling compactions & flushes 2023-11-25 12:56:08,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:56:08,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:56:08,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. after waiting 0 ms 2023-11-25 12:56:08,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:56:08,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/ns/testMinorCompaction/28de3526844060bb212fbaedf7d89ec8/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-25 12:56:08,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:56:08,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 28de3526844060bb212fbaedf7d89ec8: 2023-11-25 12:56:08,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1700916918027.28de3526844060bb212fbaedf7d89ec8. 2023-11-25 12:56:08,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f338262d368d869dcf38f98b5e0eb5d, disabling compactions & flushes 2023-11-25 12:56:08,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:56:08,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:56:08,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. after waiting 0 ms 2023-11-25 12:56:08,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:56:08,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/5f338262d368d869dcf38f98b5e0eb5d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-25 12:56:08,813 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-25 12:56:08,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:56:08,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f338262d368d869dcf38f98b5e0eb5d: 2023-11-25 12:56:08,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1700916948413.5f338262d368d869dcf38f98b5e0eb5d. 2023-11-25 12:56:08,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a5af6d2effa8ff8710911206706bc4ff, disabling compactions & flushes 2023-11-25 12:56:08,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:56:08,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:56:08,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. after waiting 0 ms 2023-11-25 12:56:08,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:56:08,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/a5af6d2effa8ff8710911206706bc4ff/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-25 12:56:08,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:56:08,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a5af6d2effa8ff8710911206706bc4ff: 2023-11-25 12:56:08,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1700916839850.a5af6d2effa8ff8710911206706bc4ff. 2023-11-25 12:56:08,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 67ff462843156320a06b388981969e08, disabling compactions & flushes 2023-11-25 12:56:08,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:56:08,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:56:08,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. after waiting 0 ms 2023-11-25 12:56:08,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:56:08,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testCompactionWithHFileLink/67ff462843156320a06b388981969e08/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-25 12:56:08,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:56:08,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 67ff462843156320a06b388981969e08: 2023-11-25 12:56:08,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1700916893094.67ff462843156320a06b388981969e08. 2023-11-25 12:56:08,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 26762a13b8f4e0904821d5326eb08429, disabling compactions & flushes 2023-11-25 12:56:08,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:56:08,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:56:08,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. after waiting 0 ms 2023-11-25 12:56:08,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:56:08,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionFromAdmin/26762a13b8f4e0904821d5326eb08429/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-25 12:56:08,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:56:08,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 26762a13b8f4e0904821d5326eb08429: 2023-11-25 12:56:08,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1700916948413.26762a13b8f4e0904821d5326eb08429. 2023-11-25 12:56:08,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e2b716da1809d768d144f498d4caadc1, disabling compactions & flushes 2023-11-25 12:56:08,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1. 2023-11-25 12:56:08,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1. 2023-11-25 12:56:08,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1. after waiting 0 ms 2023-11-25 12:56:08,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1. 2023-11-25 12:56:08,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e2b716da1809d768d144f498d4caadc1 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-25 12:56:08,951 DEBUG [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1507): Waiting on 01cde85952d5e08a35d21599fa528f30, 1588230740, 1ec2e29f51499fb50f28c15f7410a96e, c57e11eaeca2312f287d1e59e1894d94, e2b716da1809d768d144f498d4caadc1 2023-11-25 12:56:09,151 DEBUG [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1507): Waiting on 01cde85952d5e08a35d21599fa528f30, 1588230740, 1ec2e29f51499fb50f28c15f7410a96e, c57e11eaeca2312f287d1e59e1894d94, e2b716da1809d768d144f498d4caadc1 2023-11-25 12:56:09,166 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/.tmp/info/36aefa3371ba4c8486f17a3ef33e3291 2023-11-25 12:56:09,171 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36aefa3371ba4c8486f17a3ef33e3291 2023-11-25 12:56:09,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/namespace/e2b716da1809d768d144f498d4caadc1/.tmp/info/00f888b51c684695aa7f922616943e34 2023-11-25 12:56:09,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/namespace/e2b716da1809d768d144f498d4caadc1/.tmp/info/00f888b51c684695aa7f922616943e34 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/namespace/e2b716da1809d768d144f498d4caadc1/info/00f888b51c684695aa7f922616943e34 2023-11-25 12:56:09,239 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/namespace/e2b716da1809d768d144f498d4caadc1/info/00f888b51c684695aa7f922616943e34, entries=3, sequenceid=7, filesize=4.8 K 2023-11-25 12:56:09,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for e2b716da1809d768d144f498d4caadc1 in 416ms, sequenceid=7, compaction requested=false 2023-11-25 12:56:09,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/namespace/e2b716da1809d768d144f498d4caadc1/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-25 12:56:09,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1. 2023-11-25 12:56:09,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e2b716da1809d768d144f498d4caadc1: 2023-11-25 12:56:09,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1700916803675.e2b716da1809d768d144f498d4caadc1. 2023-11-25 12:56:09,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c57e11eaeca2312f287d1e59e1894d94, disabling compactions & flushes 2023-11-25 12:56:09,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:56:09,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:56:09,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. after waiting 0 ms 2023-11-25 12:56:09,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:56:09,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testScannerOnBulkLoadRefHFiles/c57e11eaeca2312f287d1e59e1894d94/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-25 12:56:09,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:56:09,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c57e11eaeca2312f287d1e59e1894d94: 2023-11-25 12:56:09,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1700916839850.c57e11eaeca2312f287d1e59e1894d94. 2023-11-25 12:56:09,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1ec2e29f51499fb50f28c15f7410a96e, disabling compactions & flushes 2023-11-25 12:56:09,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:56:09,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:56:09,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. after waiting 0 ms 2023-11-25 12:56:09,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:56:09,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1ec2e29f51499fb50f28c15f7410a96e/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-25 12:56:09,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:56:09,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1ec2e29f51499fb50f28c15f7410a96e: 2023-11-25 12:56:09,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700916805248.1ec2e29f51499fb50f28c15f7410a96e. 2023-11-25 12:56:09,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 01cde85952d5e08a35d21599fa528f30, disabling compactions & flushes 2023-11-25 12:56:09,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:56:09,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:56:09,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. after waiting 0 ms 2023-11-25 12:56:09,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:56:09,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/01cde85952d5e08a35d21599fa528f30/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-25 12:56:09,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:56:09,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 01cde85952d5e08a35d21599fa528f30: 2023-11-25 12:56:09,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700916873018.01cde85952d5e08a35d21599fa528f30. 2023-11-25 12:56:09,351 DEBUG [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1507): Waiting on 1588230740 2023-11-25 12:56:09,552 DEBUG [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1507): Waiting on 1588230740 2023-11-25 12:56:09,577 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/.tmp/rep_barrier/b7639a6abde943d484686bab9f5b1032 2023-11-25 12:56:09,581 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7639a6abde943d484686bab9f5b1032 2023-11-25 12:56:09,653 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-25 12:56:09,654 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-25 12:56:09,752 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1477): Waiting on 1 regions to close 2023-11-25 12:56:09,752 DEBUG [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1481): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-11-25 12:56:09,752 DEBUG [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1507): Waiting on 1588230740 2023-11-25 12:56:09,952 DEBUG [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1507): Waiting on 1588230740 2023-11-25 12:56:09,988 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/.tmp/table/431d57ba116041e09a5beb9d69c117cb 2023-11-25 12:56:09,991 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 431d57ba116041e09a5beb9d69c117cb 2023-11-25 12:56:09,992 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/.tmp/info/36aefa3371ba4c8486f17a3ef33e3291 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/info/36aefa3371ba4c8486f17a3ef33e3291 2023-11-25 12:56:09,995 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36aefa3371ba4c8486f17a3ef33e3291 2023-11-25 12:56:09,995 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/info/36aefa3371ba4c8486f17a3ef33e3291, entries=226, sequenceid=130, filesize=37.9 K 2023-11-25 12:56:09,995 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/.tmp/rep_barrier/b7639a6abde943d484686bab9f5b1032 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/rep_barrier/b7639a6abde943d484686bab9f5b1032 2023-11-25 12:56:09,999 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7639a6abde943d484686bab9f5b1032 2023-11-25 12:56:10,000 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/rep_barrier/b7639a6abde943d484686bab9f5b1032, entries=1, sequenceid=130, filesize=5.0 K 2023-11-25 12:56:10,000 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/.tmp/table/431d57ba116041e09a5beb9d69c117cb as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/table/431d57ba116041e09a5beb9d69c117cb 2023-11-25 12:56:10,003 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 431d57ba116041e09a5beb9d69c117cb 2023-11-25 12:56:10,003 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/table/431d57ba116041e09a5beb9d69c117cb, entries=27, sequenceid=130, filesize=6.6 K 2023-11-25 12:56:10,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1255ms, sequenceid=130, compaction requested=false 2023-11-25 12:56:10,008 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-25 12:56:10,009 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-25 12:56:10,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-25 12:56:10,009 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-25 12:56:10,009 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-25 12:56:10,071 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-25 12:56:10,152 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,37051,1700916801082; all regions closed. 2023-11-25 12:56:10,159 DEBUG [RS:0;jenkins-hbase4:37051] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/oldWALs 2023-11-25 12:56:10,160 INFO [RS:0;jenkins-hbase4:37051] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37051%2C1700916801082.meta:.meta(num 1700916803417) 2023-11-25 12:56:10,163 DEBUG [RS:0;jenkins-hbase4:37051] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/oldWALs 2023-11-25 12:56:10,163 INFO [RS:0;jenkins-hbase4:37051] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37051%2C1700916801082:(num 1700916802816) 2023-11-25 12:56:10,163 DEBUG [RS:0;jenkins-hbase4:37051] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:56:10,163 INFO [RS:0;jenkins-hbase4:37051] regionserver.LeaseManager(133): Closed leases 2023-11-25 12:56:10,164 INFO [RS:0;jenkins-hbase4:37051] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-25 12:56:10,164 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-25 12:56:10,165 INFO [RS:0;jenkins-hbase4:37051] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37051 2023-11-25 12:56:10,172 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37051,1700916801082 2023-11-25 12:56:10,172 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-25 12:56:10,172 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-25 12:56:10,175 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37051,1700916801082] 2023-11-25 12:56:10,175 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37051,1700916801082; numProcessing=1 2023-11-25 12:56:10,176 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37051,1700916801082 already deleted, retry=false 2023-11-25 12:56:10,176 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,37051,1700916801082 expired; onlineServers=0 2023-11-25 12:56:10,176 INFO [RegionServerTracker-0] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,38201,1700916799909' ***** 2023-11-25 12:56:10,176 INFO [RegionServerTracker-0] regionserver.HRegionServer(2314): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-25 12:56:10,177 DEBUG [M:0;jenkins-hbase4:38201] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b965ded, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-25 12:56:10,177 INFO [M:0;jenkins-hbase4:38201] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,38201,1700916799909 2023-11-25 12:56:10,177 INFO [M:0;jenkins-hbase4:38201] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,38201,1700916799909; all regions closed. 2023-11-25 12:56:10,177 DEBUG [M:0;jenkins-hbase4:38201] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-25 12:56:10,177 DEBUG [M:0;jenkins-hbase4:38201] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-25 12:56:10,177 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-25 12:56:10,177 DEBUG [M:0;jenkins-hbase4:38201] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-25 12:56:10,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700916802556] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700916802556,5,FailOnTimeoutGroup] 2023-11-25 12:56:10,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700916802555] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700916802555,5,FailOnTimeoutGroup] 2023-11-25 12:56:10,177 INFO [M:0;jenkins-hbase4:38201] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-25 12:56:10,177 INFO [M:0;jenkins-hbase4:38201] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-25 12:56:10,178 INFO [M:0;jenkins-hbase4:38201] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-11-25 12:56:10,178 DEBUG [M:0;jenkins-hbase4:38201] master.HMaster(1512): Stopping service threads 2023-11-25 12:56:10,178 INFO [M:0;jenkins-hbase4:38201] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-25 12:56:10,179 ERROR [M:0;jenkins-hbase4:38201] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-11-25 12:56:10,179 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-25 12:56:10,179 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-25 12:56:10,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-25 12:56:10,179 INFO [M:0;jenkins-hbase4:38201] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-25 12:56:10,179 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-25 12:56:10,179 DEBUG [M:0;jenkins-hbase4:38201] zookeeper.ZKUtil(399): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-25 12:56:10,180 WARN [M:0;jenkins-hbase4:38201] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-25 12:56:10,180 INFO [M:0;jenkins-hbase4:38201] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-25 12:56:10,180 INFO [M:0;jenkins-hbase4:38201] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-25 12:56:10,180 DEBUG [M:0;jenkins-hbase4:38201] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-25 12:56:10,180 INFO [M:0;jenkins-hbase4:38201] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-25 12:56:10,180 DEBUG [M:0;jenkins-hbase4:38201] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-25 12:56:10,180 DEBUG [M:0;jenkins-hbase4:38201] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-25 12:56:10,180 DEBUG [M:0;jenkins-hbase4:38201] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-25 12:56:10,180 INFO [M:0;jenkins-hbase4:38201] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.72 KB heapSize=598.84 KB 2023-11-25 12:56:10,275 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-25 12:56:10,275 INFO [RS:0;jenkins-hbase4:37051] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,37051,1700916801082; zookeeper connection closed. 2023-11-25 12:56:10,275 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): regionserver:37051-0x100249a8a3e0001, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-25 12:56:10,276 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4e603c78] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4e603c78 2023-11-25 12:56:10,276 INFO [Listener at localhost/45289] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-25 12:56:10,587 INFO [M:0;jenkins-hbase4:38201] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.72 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1c6bf073b5df41e48c7d3b14c6360a55 2023-11-25 12:56:10,592 INFO [M:0;jenkins-hbase4:38201] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c6bf073b5df41e48c7d3b14c6360a55 2023-11-25 12:56:10,593 DEBUG [M:0;jenkins-hbase4:38201] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1c6bf073b5df41e48c7d3b14c6360a55 as hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1c6bf073b5df41e48c7d3b14c6360a55 2023-11-25 12:56:10,597 INFO [M:0;jenkins-hbase4:38201] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c6bf073b5df41e48c7d3b14c6360a55 2023-11-25 12:56:10,597 INFO [M:0;jenkins-hbase4:38201] regionserver.HStore(1080): Added hdfs://localhost:45839/user/jenkins/test-data/192ea844-ee7b-3961-1acd-455d2b0b550f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1c6bf073b5df41e48c7d3b14c6360a55, entries=123, sequenceid=1011, filesize=33.3 K 2023-11-25 12:56:10,598 INFO [M:0;jenkins-hbase4:38201] regionserver.HRegion(2948): Finished flush of dataSize ~512.72 KB/525027, heapSize ~598.82 KB/613192, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 418ms, sequenceid=1011, compaction requested=false 2023-11-25 12:56:10,599 INFO [M:0;jenkins-hbase4:38201] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-25 12:56:10,599 DEBUG [M:0;jenkins-hbase4:38201] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-25 12:56:10,603 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-25 12:56:10,603 INFO [M:0;jenkins-hbase4:38201] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-25 12:56:10,603 INFO [M:0;jenkins-hbase4:38201] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38201 2023-11-25 12:56:10,606 DEBUG [M:0;jenkins-hbase4:38201] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38201,1700916799909 already deleted, retry=false 2023-11-25 12:56:10,711 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-25 12:56:10,711 DEBUG [Listener at localhost/45289-EventThread] zookeeper.ZKWatcher(600): master:38201-0x100249a8a3e0000, quorum=127.0.0.1:63200, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-25 12:56:10,711 INFO [M:0;jenkins-hbase4:38201] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,38201,1700916799909; zookeeper connection closed. 2023-11-25 12:56:10,713 WARN [Listener at localhost/45289] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-25 12:56:10,722 INFO [Listener at localhost/45289] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-25 12:56:10,829 WARN [BP-1245857509-172.31.14.131-1700916796538 heartbeating to localhost/127.0.0.1:45839] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-25 12:56:10,829 WARN [BP-1245857509-172.31.14.131-1700916796538 heartbeating to localhost/127.0.0.1:45839] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1245857509-172.31.14.131-1700916796538 (Datanode Uuid b85de168-f567-4fe6-a311-baf86bbdb821) service to localhost/127.0.0.1:45839 2023-11-25 12:56:10,831 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/cluster_099e5cbf-51cd-003d-9e5e-00eb47e6e9bf/dfs/data/data1/current/BP-1245857509-172.31.14.131-1700916796538] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-25 12:56:10,831 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5aa69bb1-5c1a-103e-6990-18a9259397f4/cluster_099e5cbf-51cd-003d-9e5e-00eb47e6e9bf/dfs/data/data2/current/BP-1245857509-172.31.14.131-1700916796538] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-25 12:56:10,862 INFO [Listener at localhost/45289] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-25 12:56:10,994 INFO [Listener at localhost/45289] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-25 12:56:11,075 INFO [Listener at localhost/45289] hbase.HBaseTestingUtility(1293): Minicluster is down